Bed having sensor fusing features useful for determining snore and breathing parameters

ABSTRACT

A mattress supports a user. An acoustic sensor is configured to sense acoustic energy. A pressure sensor senses pressure applied to the mattress. A controller is configured to receive an acoustic stream from the acoustic sensor. The controller is further configured to receive a pressure stream from the pressure sensor. The controller is further configured to combine the acoustic stream and the pressure stream in order to generate a set of snore/breath parameters. The controller is further configured to determine that a home-automation rule includes a condition that includes the generated set of snore/breath parameters. The controller is further configured to, responsive to determining that a home-automation rule includes a condition that includes the generated set of snore/breath parameters, send an instruction to drive a controllable device to the controllable device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to U.S. Application Ser. No.62/611,146, filed on Dec. 28, 2017. The disclosure of the priorapplication is considered part of the disclosure of this application,and is incorporated in its entirety into this application.

BACKGROUND

In general, a bed is a piece of furniture used as a location to sleep orrelax. Many modern beds include a soft mattress on a bed frame. Themattress may include springs, foam material, and/or an air chamber tosupport the weight of one or more occupants.

SUMMARY

In one aspect, a bed system includes a mattress to support a user. Thesystem further includes an acoustic sensor configured to sense acousticenergy in the environment of the user. The system further includes apressure sensor configured to sense pressure applied to the mattress bythe user laying on the mattress. The system further includes acontroller configured to: receive an acoustic stream from the acousticsensor, the acoustic stream representing the acoustic energy sensed bythe acoustic sensor. The controller is further configured to receive apressure stream from the pressure sensor, the pressure streamrepresenting the pressure sensed by the pressure sensor. The controlleris further configured to combine the acoustic stream and the pressurestream in order to generate a set of snore/breath parameters. Thecontroller is further configured to determine that a home-automationrule includes a condition that includes the generated set ofsnore/breath parameters. The controller is further configured to,responsive to determining that a home-automation rule includes acondition that includes the generated set of snore/breath parameters,send an instruction to drive a controllable device to the controllabledevice. Other systems, devices, methods, and computer-readable mediumsmay be used.

Implementations can include any, all, or none of the following features.The bed system including the controllable device, the controllabledevice configured to: receive the instruction to drive the controllabledevice; and responsive to receiving the instruction to drive thecontrollable device, drive in order to alter the environment of theuser. To combine the acoustic stream and the pressure stream, thecontroller is further configured to: determine respiratory parametersbased on instantaneous pressure signals; determine respiratoryparameters based on instantaneous acoustic signals; and identifyincidences of matching of both the respiratory parameters based oninstantaneous pressure signals and of the respiratory parameters basedon instantaneous acoustic signals. To combine the acoustic stream andthe pressure stream, the controller is further configured to: identifyfeatures of potential snores and breaths from the acoustic stream;identify features of potential snores and breaths from the pressurestream; and identify agreements of the potential snores and breaths fromthe acoustic stream and of the potential snores and breaths from thepressure stream. To combine the acoustic stream and the pressure stream,the controller is further configured to: determine that the user ispresent in on the mattress; determine that the user is asleep; andresponsive to determining that the user is present in on the mattressand that the user is asleep, generate a vote to represent a candidateset of snore/breath parameters. To combine the acoustic stream and thepressure stream, the controller is further configured to: apply theacoustic stream and the pressure stream to one or more fusion algorithmsthat each are configured to, responsive to receiving both an acousticstream and a pressure stream, generate a vote to represent a candidateset of snore/breath parameters that describe the snoring and breathingaction of the user on the bed; tallying the votes in order to determinea winning set of snore/breath parameters; select the winning set ofsnore/breath parameters as the generated set of snore/breath parameters.The acoustic sensor includes a signal conditioner; and a digitizer;wherein the acoustic stream is a digital stream of data. The pressuresensor includes a signal conditioner; and a digitizer; wherein thepressure stream is a digital stream of data. To combine the acousticstream and the pressure stream in order to generate a set ofsnore/breath parameters, the controller is configured to: receive boththe acoustic stream and the pressure stream into a single buffer; afterreceiving both the acoustic stream and the pressure stream into a singlebuffer, normalize the acoustic stream in a particular domain; afterreceiving both the acoustic stream and the pressure stream into a singlebuffer, separately normalizing the pressure stream in the particulardomain; and fuse the normalized pressure stream and the normalizedacoustic stream into the set of snore/breath parameters. To combine theacoustic stream and the pressure stream in order to generate a set ofsnore/breath parameters, the controller is configured to: receive theacoustic stream into an acoustic buffer; receive the pressure streaminto a pressure buffer separate from the acoustic buffer; estimateacoustic parameters in a particular domain; estimate pressure parametersin the particular domain; and fuse the estimated acoustic parameterswith the estimated pressure parameters. Combine the acoustic stream andthe pressure stream in order to generate a set of snore/breathparameters, the controller is configured to: compute acoustic featuresin a particular domain; compute pressure features in the particulardomain; and apply machine learning classifiers to both the acousticfeatures and the pressure features. To combine the acoustic stream andthe pressure stream in order to generate a set of snore/breathparameters, the controller is configured to: receive both the acousticstream and the pressure stream into a single buffer; after receivingboth the acoustic stream and the pressure stream into a single buffer,normalize the acoustic stream in a particular domain; after receivingboth the acoustic stream and the pressure stream into a single buffer,separately normalizing the pressure stream in the particular domain; andoperate a deep-learning model on the normalized pressure stream and thenormalized acoustic stream.

Implementations can include any, all, or none of the following features.

The technology related to breathing and snore sensing is herebyimproved. This technology provides an automated and reliable scheme forsnore and breathing monitoring at homes using dual modality sensorfusion—acoustic waves generated in the air and pressure variationsgenerated in the air chamber of an inflatable mattress. Real-time snoreand breathing monitoring and analysis by fusing the multitude of datafrom the acoustic and pressure sensing modalities is provided. Such dualsensing modality provides advantages over using single source acousticdata often used in commercial snore and breathing monitoring systems.This dual sensing scheme provides a way for automated snore andbreathing monitoring by incorporating the bed presence and sleep statusof a user, thereby increasing accuracy. Pressure sensing makes use ofsnore and breathing signals registered to the bed's air chamber pressuresignal and can improve accuracy of snore detection and analysis. Dualsensing systems can be made more resistant to false alarms fromenvironmental noise due to the incorporation of sensing phenomena otherthan environmental noise. Dual sensing can provide a practical, costeffective mechanism to identify a snorer in partners sleeping scenariowhich otherwise would be difficult or not possible with a singleacoustic sensor.

Other features, aspects and potential advantages will be apparent fromthe accompanying description and figures.

DESCRIPTION OF DRAWINGS

FIG. 1 shows an example air bed system.

FIG. 2 is a block diagram of an example of various components of an airbed system.

FIG. 3 shows an example environment including a bed in communicationwith devices located in and around a home.

FIGS. 4A and 4B are block diagrams of example data processing systemsthat can be associated with a bed.

FIGS. 5 and 6 are block diagrams of examples of motherboards that can beused in a data processing system that can be associated with a bed.

FIG. 7 is a block diagram of an example of a daughterboard that can beused in a data processing system that can be associated with a bed.

FIG. 8 is a block diagram of an example of a motherboard with nodaughterboard that can be used in a data processing system that can beassociated with a bed.

FIG. 9 is a block diagram of an example of a sensory array that can beused in a data processing system that can be associated with a bed.

FIG. 10 is a block diagram of an example of a control array that can beused in a data processing system that can be associated with a bed

FIG. 11 is a block diagram of an example of a computing device that canbe used in a data processing system that can be associated with a bed.

FIGS. 12-16 are block diagrams of example cloud services that can beused in a data processing system that can be associated with a bed.

FIG. 17 is a block diagram of an example of using a data processingsystem that can be associated with a bed to automate peripherals aroundthe bed.

FIG. 18 is a schematic diagram that shows an example of a computingdevice and a mobile computing device.

FIG. 19 is a block diagram of an example of a system for fusing acousticdata with pressure data in order to determine snore and breathingparameters for a user on a bed.

FIG. 20 is drawing of example sensor readings collected from acousticand pressure sensors.

FIG. 21 is a swimlane diagram of an example process for determiningsnore and breath parameters and for driving a controllable device.

FIG. 22 is a swimlane diagram of an example process for determiningsnore and breath parameters and for driving a controllable device.

FIG. 23 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

FIG. 24 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

FIG. 25 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

FIG. 26 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

FIG. 27 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

FIG. 28 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

FIG. 29 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

FIG. 30 is a flowchart diagram of an example process for fusing streamsof pressure and acoustic data.

Like reference symbols in the various drawings indicate like elements.

DETAILED DESCRIPTION

A bed system uses a fusion of acoustic sensing and pressure sensing todetermine snore and breathing parameters. A controller can receivestreams of acoustic readings from an acoustic sensor such as amicrophone installed in the room or part of the bed, and at the sametime receive streams of pressure readings from a pressure sensorinstalled in the air mattress or sleeping pad.

Example Airbed Hardware

FIG. 1 shows an example air bed system 100 that includes a bed 112. Thebed 112 includes at least one air chamber 114 surrounded by a resilientborder 116 and encapsulated by bed ticking 118. The resilient border 116can comprise any suitable material, such as foam.

As illustrated in FIG. 1, the bed 112 can be a two chamber design havingfirst and second fluid chambers, such as a first air chamber 114A and asecond air chamber 114B. In alternative embodiments, the bed 112 caninclude chambers for use with fluids other than air that are suitablefor the application. In some embodiments, such as single beds or kids'beds, the bed 112 can include a single air chamber 114A or 114B ormultiple air chambers 114A and 114B. First and second air chambers 114Aand 114B can be in fluid communication with a pump 120. The pump 120 canbe in electrical communication with a remote control 122 via control box124. The control box 124 can include a wired or wireless communicationsinterface for communicating with one or more devices, including theremote control 122. The control box 124 can be configured to operate thepump 120 to cause increases and decreases in the fluid pressure of thefirst and second air chambers 114A and 114B based upon commands input bya user using the remote control 122. In some implementations, thecontrol box 124 is integrated into a housing of the pump 120.

The remote control 122 can include a display 126, an output selectingmechanism 128, a pressure increase button 129, and a pressure decreasebutton 130. The output selecting mechanism 128 can allow the user toswitch air flow generated by the pump 120 between the first and secondair chambers 114A and 114B, thus enabling control of multiple airchambers with a single remote control 122 and a single pump 120. Forexample, the output selecting mechanism 128 can by a physical control(e.g., switch or button) or an input control displayed on display 126.Alternatively, separate remote control units can be provided for eachair chamber and can each include the ability to control multiple airchambers. Pressure increase and decrease buttons 129 and 130 can allow auser to increase or decrease the pressure, respectively, in the airchamber selected with the output selecting mechanism 128. Adjusting thepressure within the selected air chamber can cause a correspondingadjustment to the firmness of the respective air chamber. In someembodiments, the remote control 122 can be omitted or modified asappropriate for an application. For example, in some embodiments the bed112 can be controlled by a computer, tablet, smart phone, or otherdevice in wired or wireless communication with the bed 112.

FIG. 2 is a block diagram of an example of various components of an airbed system. For example, these components can be used in the example airbed system 100. As shown in FIG. 2, the control box 124 can include apower supply 134, a processor 136, a memory 137, a switching mechanism138, and an analog to digital (A/D) converter 140. The switchingmechanism 138 can be, for example, a relay or a solid state switch. Insome implementations, the switching mechanism 138 can be located in thepump 120 rather than the control box 124.

The pump 120 and the remote control 122 are in two-way communicationwith the control box 124. The pump 120 includes a motor 142, a pumpmanifold 143, a relief valve 144, a first control valve 145A, a secondcontrol valve 145B, and a pressure transducer 146. The pump 120 isfluidly connected with the first air chamber 114A and the second airchamber 114B via a first tube 148A and a second tube 148B, respectively.The first and second control valves 145A and 145B can be controlled byswitching mechanism 138, and are operable to regulate the flow of fluidbetween the pump 120 and first and second air chambers 114A and 114B,respectively.

In some implementations, the pump 120 and the control box 124 can beprovided and packaged as a single unit. In some alternativeimplementations, the pump 120 and the control box 124 can be provided asphysically separate units. In some implementations, the control box 124,the pump 120, or both are integrated within or otherwise containedwithin a bed frame or bed support structure that supports the bed 112.In some implementations, the control box 124, the pump 120, or both arelocated outside of a bed frame or bed support structure (as shown in theexample in FIG. 1).

The example air bed system 100 depicted in FIG. 2 includes the two airchambers 114A and 114B and the single pump 120. However, otherimplementations can include an air bed system having two or more airchambers and one or more pumps incorporated into the air bed system tocontrol the air chambers. For example, a separate pump can be associatedwith each air chamber of the air bed system or a pump can be associatedwith multiple chambers of the air bed system. Separate pumps can alloweach air chamber to be inflated or deflated independently andsimultaneously. Furthermore, additional pressure transducers can also beincorporated into the air bed system such that, for example, a separatepressure transducer can be associated with each air chamber.

In use, the processor 136 can, for example, send a decrease pressurecommand to one of air chambers 114A or 114B, and the switching mechanism138 can be used to convert the low voltage command signals sent by theprocessor 136 to higher operating voltages sufficient to operate therelief valve 144 of the pump 120 and open the control valve 145A or145B. Opening the relief valve 144 can allow air to escape from the airchamber 114A or 114B through the respective air tube 148A or 148B.During deflation, the pressure transducer 146 can send pressure readingsto the processor 136 via the A/D converter 140. The A/D converter 140can receive analog information from pressure transducer 146 and canconvert the analog information to digital information useable by theprocessor 136. The processor 136 can send the digital signal to theremote control 122 to update the display 126 in order to convey thepressure information to the user.

As another example, the processor 136 can send an increase pressurecommand. The pump motor 142 can be energized in response to the increasepressure command and send air to the designated one of the air chambers114A or 114B through the air tube 148A or 148B via electronicallyoperating the corresponding valve 145A or 145B. While air is beingdelivered to the designated air chamber 114A or 114B in order toincrease the firmness of the chamber, the pressure transducer 146 cansense pressure within the pump manifold 143. Again, the pressuretransducer 146 can send pressure readings to the processor 136 via theA/D converter 140. The processor 136 can use the information receivedfrom the A/D converter 140 to determine the difference between theactual pressure in air chamber 114A or 114B and the desired pressure.The processor 136 can send the digital signal to the remote control 122to update display 126 in order to convey the pressure information to theuser.

Generally speaking, during an inflation or deflation process, thepressure sensed within the pump manifold 143 can provide anapproximation of the pressure within the respective air chamber that isin fluid communication with the pump manifold 143. An example method ofobtaining a pump manifold pressure reading that is substantiallyequivalent to the actual pressure within an air chamber includes turningoff pump 120, allowing the pressure within the air chamber 114A or 114Band the pump manifold 143 to equalize, and then sensing the pressurewithin the pump manifold 143 with the pressure transducer 146. Thus,providing a sufficient amount of time to allow the pressures within thepump manifold 143 and chamber 114A or 114B to equalize can result inpressure readings that are accurate approximations of the actualpressure within air chamber 114A or 114B. In some implementations, thepressure of the air chambers 114A and/or 114B can be continuouslymonitored using multiple pressure sensors (not shown).

In some implementations, information collected by the pressuretransducer 146 can be analyzed to determine various states of a personlying on the bed 112. For example, the processor 136 can use informationcollected by the pressure transducer 146 to determine a heart rate or arespiration rate for a person lying in the bed 112. For example, a usercan be lying on a side of the bed 112 that includes the chamber 114A.The pressure transducer 146 can monitor fluctuations in pressure of thechamber 114A and this information can be used to determine the user'sheart rate and/or respiration rate. As another example, additionalprocessing can be performed using the collected data to determine asleep state of the person (e.g., awake, light sleep, deep sleep). Forexample, the processor 136 can determine when a person falls asleep and,while asleep, the various sleep states of the person.

Additional information associated with a user of the air bed system 100that can be determined using information collected by the pressuretransducer 146 includes motion of the user, presence of the user on asurface of the bed 112, weight of the user, heart arrhythmia of theuser, and apnea. Taking user presence detection for example, thepressure transducer 146 can be used to detect the user's presence on thebed 112, e.g., via a gross pressure change determination and/or via oneor more of a respiration rate signal, heart rate signal, and/or otherbiometric signals. For example, a simple pressure detection process canidentify an increase in pressure as an indication that the user ispresent on the bed 112. As another example, the processor 136 candetermine that the user is present on the bed 112 if the detectedpressure increases above a specified threshold (so as to indicate that aperson or other object above a certain weight is positioned on the bed112). As yet another example, the processor 136 can identify an increasein pressure in combination with detected slight, rhythmic fluctuationsin pressure as corresponding to the user being present on the bed 112.The presence of rhythmic fluctuations can be identified as being causedby respiration or heart rhythm (or both) of the user. The detection ofrespiration or a heartbeat can distinguish between the user beingpresent on the bed and another object (e.g., a suit case) being placedupon the bed.

In some implementations, fluctuations in pressure can be measured at thepump 120. For example, one or more pressure sensors can be locatedwithin one or more internal cavities of the pump 120 to detectfluctuations in pressure within the pump 120. The fluctuations inpressure detected at the pump 120 can indicate fluctuations in pressurein one or both of the chambers 114A and 114B. One or more sensorslocated at the pump 120 can be in fluid communication with the one orboth of the chambers 114A and 114B, and the sensors can be operative todetermine pressure within the chambers 114A and 114B. The control box124 can be configured to determine at least one vital sign (e.g., heartrate, respiratory rate) based on the pressure within the chamber 114A orthe chamber 114B.

In some implementations, the control box 124 can analyze a pressuresignal detected by one or more pressure sensors to determine a heartrate, respiration rate, and/or other vital signs of a user lying orsitting on the chamber 114A or the chamber 114B. More specifically, whena user lies on the bed 112 positioned over the chamber 114A, each of theuser's heart beats, breaths, and other movements can create a force onthe bed 112 that is transmitted to the chamber 114A. As a result of theforce input to the chamber 114A from the user's movement, a wave canpropagate through the chamber 114A and into the pump 120. A pressuresensor located at the pump 120 can detect the wave, and thus thepressure signal output by the sensor can indicate a heart rate,respiratory rate, or other information regarding the user.

With regard to sleep state, air bed system 100 can determine a user'ssleep state by using various biometric signals such as heart rate,respiration, and/or movement of the user. While the user is sleeping,the processor 136 can receive one or more of the user's biometricsignals (e.g., heart rate, respiration, and motion) and determine theuser's present sleep state based on the received biometric signals. Insome implementations, signals indicating fluctuations in pressure in oneor both of the chambers 114A and 114B can be amplified and/or filteredto allow for more precise detection of heart rate and respiratory rate.

The control box 124 can perform a pattern recognition algorithm or othercalculation based on the amplified and filtered pressure signal todetermine the user's heart rate and respiratory rate. For example, thealgorithm or calculation can be based on assumptions that a heart rateportion of the signal has a frequency in the range of 0.5-4.0 Hz andthat a respiration rate portion of the signal a has a frequency in therange of less than 1 Hz. The control box 124 can also be configured todetermine other characteristics of a user based on the received pressuresignal, such as blood pressure, tossing and turning movements, rollingmovements, limb movements, weight, the presence or lack of presence of auser, and/or the identity of the user. Techniques for monitoring auser's sleep using heart rate information, respiration rate information,and other user information are disclosed in U.S. Patent ApplicationPublication No. 20100170043 to Steven J. Young et al., titled “APPARATUSFOR MONITORING VITAL SIGNS,” the entire contents of which isincorporated herein by reference.

For example, the pressure transducer 146 can be used to monitor the airpressure in the chambers 114A and 114B of the bed 112. If the user onthe bed 112 is not moving, the air pressure changes in the air chamber114A or 114B can be relatively minimal, and can be attributable torespiration and/or heartbeat. When the user on the bed 112 is moving,however, the air pressure in the mattress can fluctuate by a much largeramount. Thus, the pressure signals generated by the pressure transducer146 and received by the processor 136 can be filtered and indicated ascorresponding to motion, heartbeat, or respiration.

In some implementations, rather than performing the data analysis in thecontrol box 124 with the processor 136, a digital signal processor (DSP)can be provided to analyze the data collected by the pressure transducer146. Alternatively, the data collected by the pressure transducer 146could be sent to a cloud-based computing system for remote analysis.

In some implementations, the example air bed system 100 further includesa temperature controller configured to increase, decrease, or maintainthe temperature of a bed, for example for the comfort of the user. Forexample, a pad can be placed on top of or be part of the bed 112, or canbe placed on top of or be part of one or both of the chambers 114A and114B. Air can be pushed through the pad and vented to cool off a user ofthe bed. Conversely, the pad can include a heating element that can beused to keep the user warm. In some implementations, the temperaturecontroller can receive temperature readings from the pad. In someimplementations, separate pads are used for the different sides of thebed 112 (e.g., corresponding to the locations of the chambers 114A and114B) to provide for differing temperature control for the differentsides of the bed.

In some implementations, the user of the air bed system 100 can use aninput device, such as the remote control 122, to input a desiredtemperature for the surface of the bed 112 (or for a portion of thesurface of the bed 112). The desired temperature can be encapsulated ina command data structure that includes the desired temperature as wellas identifies the temperature controller as the desired component to becontrolled. The command data structure can then be transmitted viaBluetooth or another suitable communication protocol to the processor136. In various examples, the command data structure is encrypted beforebeing transmitted. The temperature controller can then configure itselements to increase or decrease the temperature of the pad depending onthe temperature input into remote control 122 by the user.

In some implementations, data can be transmitted from a component backto the processor 136 or to one or more display devices, such as thedisplay 126. For example, the current temperature as determined by asensor element of temperature controller, the pressure of the bed, thecurrent position of the foundation or other information can betransmitted to control box 124. The control box 124 can then transmitthe received information to remote control 122 where it can be displayedto the user (e.g., on the display 126).

In some implementations, the example air bed system 100 further includesan adjustable foundation and an articulation controller configured toadjust the position of a bed (e.g., the bed 112) by adjusting theadjustable foundation that supports the bed. For example, thearticulation controller can adjust the bed 112 from a flat position to aposition in which a head portion of a mattress of the bed is inclinedupward (e.g., to facilitate a user sitting up in bed and/or watchingtelevision). In some implementations, the bed 112 includes multipleseparately articulable sections. For example, portions of the bedcorresponding to the locations of the chambers 114A and 114B can bearticulated independently from each other, to allow one personpositioned on the bed 112 surface to rest in a first position (e.g., aflat position) while a second person rests in a second position (e.g.,an reclining position with the head raised at an angle from the waist).In some implementations, separate positions can be set for two differentbeds (e.g., two twin beds placed next to each other). The foundation ofthe bed 112 can include more than one zone that can be independentlyadjusted. The articulation controller can also be configured to providedifferent levels of massage to one or more users on the bed 112.

Example of a Bed in a Bedroom Environment

FIG. 3 shows an example environment 300 including a bed 302 incommunication with devices located in and around a home. In the exampleshown, the bed 302 includes pump 304 for controlling air pressure withintwo air chambers 306 a and 306 b (as described above with respect to theair chambers 114A-114B). The pump 304 additionally includes circuitryfor controlling inflation and deflation functionality performed by thepump 304. The circuitry is further programmed to detect fluctuations inair pressure of the air chambers 306 a-b and used the detectedfluctuations in air pressure to identify bed presence of a user 308,sleep state of the user 308, movement of the user 308, and biometricsignals of the user 308 such as heart rate and respiration rate. In theexample shown, the pump 304 is located within a support structure of thebed 302 and the control circuitry 334 for controlling the pump 304 isintegrated with the pump 304. In some implementations, the controlcircuitry 334 is physically separate from the pump 304 and is inwireless or wired communication with the pump 304. In someimplementations, the pump 304 and/or control circuitry 334 are locatedoutside of the bed 302. In some implementations, various controlfunctions can be performed by systems located in different physicallocations. For example, circuitry for controlling actions of the pump304 can be located within a pump casing of the pump 304 while controlcircuitry 334 for performing other functions associated with the bed 302can be located in another portion of the bed 302, or external to the bed302. As another example, control circuitry 334 located within the pump304 can communicate with control circuitry 334 at a remote locationthrough a LAN or WAN (e.g., the internet). As yet another example, thecontrol circuitry 334 can be included in the control box 124 of FIGS. 1and 2.

In some implementations, one or more devices other than, or in additionto, the pump 304 and control circuitry 334 can be utilized to identifyuser bed presence, sleep state, movement, and biometric signals. Forexample, the bed 302 can include a second pump in addition to the pump304, with each of the two pumps connected to a respective one of the airchambers 306 a-b. For example, the pump 304 can be in fluidcommunication with the air chamber 306 b to control inflation anddeflation of the air chamber 306 b as well as detect user signals for auser located over the air chamber 306 b such as bed presence, sleepstate, movement, and biometric signals while the second pump is in fluidcommunication with the air chamber 306 a to control inflation anddeflation of the air chamber 306 a as well as detect user signals for auser located over the air chamber 306 a.

As another example, the bed 302 can include one or more pressuresensitive pads or surface portions that are operable to detect movement,including user presence, user motion, respiration, and heart rate. Forexample, a first pressure sensitive pad can be incorporated into asurface of the bed 302 over a left portion of the bed 302, where a firstuser would normally be located during sleep, and a second pressuresensitive pad can be incorporated into the surface of the bed 302 over aright portion of the bed 302, where a second user would normally belocated during sleep. The movement detected by the one or more pressuresensitive pads or surface portions can be used by control circuitry 334to identify user sleep state, bed presence, or biometric signals.

In some implementations, information detected by the bed (e.g., motioninformation) is processed by control circuitry 334 (e.g., controlcircuitry 334 integrated with the pump 304) and provided to one or moreuser devices such as a user device 310 for presentation to the user 308or to other users. In the example depicted in FIG. 3, the user device310 is a tablet device; however, in some implementations, the userdevice 310 can be a personal computer, a smart phone, a smart television(e.g., a television 312), or other user device capable of wired orwireless communication with the control circuitry 334. The user device310 can be in communication with control circuitry 334 of the bed 302through a network or through direct point-to-point communication. Forexample, the control circuitry 334 can be connected to a LAN (e.g.,through a Wi-Fi router) and communicate with the user device 310 throughthe LAN. As another example, the control circuitry 334 and the userdevice 310 can both connect to the Internet and communicate through theInternet. For example, the control circuitry 334 can connect to theInternet through a WiFi router and the user device 310 can connect tothe Internet through communication with a cellular communication system.As another example, the control circuitry 334 can communicate directlywith the user device 310 through a wireless communication protocol suchas Bluetooth. As yet another example, the control circuitry 334 cancommunicate with the user device 310 through a wireless communicationprotocol such as ZigBee, Z-Wave, infrared, or another wirelesscommunication protocol suitable for the application. As another example,the control circuitry 334 can communicate with the user device 310through a wired connection such as, for example, a USB connector,serial/RS232, or another wired connection suitable for the application.

The user device 310 can display a variety of information and statisticsrelated to sleep, or user 308's interaction with the bed 302. Forexample, a user interface displayed by the user device 310 can presentinformation including amount of sleep for the user 308 over a period oftime (e.g., a single evening, a week, a month, etc.) amount of deepsleep, ratio of deep sleep to restless sleep, time lapse between theuser 308 getting into bed and the user 308 falling asleep, total amountof time spent in the bed 302 for a given period of time, heart rate forthe user 308 over a period of time, respiration rate for the user 308over a period of time, or other information related to user interactionwith the bed 302 by the user 308 or one or more other users of the bed302. In some implementations, information for multiple users can bepresented on the user device 310, for example information for a firstuser positioned over the air chamber 306 a can be presented along withinformation for a second user positioned over the air chamber 306 b. Insome implementations, the information presented on the user device 310can vary according to the age of the user 308. For example, theinformation presented on the user device 310 can evolve with the age ofthe user 308 such that different information is presented on the userdevice 310 as the user 308 ages as a child or an adult.

The user device 310 can also be used as an interface for the controlcircuitry 334 of the bed 302 to allow the user 308 to enter information.The information entered by the user 308 can be used by the controlcircuitry 334 to provide better information to the user or to variouscontrol signals for controlling functions of the bed 302 or otherdevices. For example, the user can enter information such as weight,height, and age and the control circuitry 334 can use this informationto provide the user 308 with a comparison of the user's tracked sleepinformation to sleep information of other people having similar weights,heights, and/or ages as the user 308. As another example, the user 308can use the user device 310 as an interface for controlling air pressureof the air chambers 306 a and 306 b, for controlling various recline orincline positions of the bed 302, for controlling temperature of one ormore surface temperature control devices of the bed 302, or for allowingthe control circuitry 334 to generate control signals for other devices(as described in greater detail below).

In some implementations, control circuitry 334 of the bed 302 (e.g.,control circuitry 334 integrated into the pump 304) can communicate withother first, second, or third party devices or systems in addition to orinstead of the user device 310. For example, the control circuitry 334can communicate with the television 312, a lighting system 314, athermostat 316, a security system 318, or other house hold devices suchas an oven 322, a coffee maker 324, a lamp 326, and a nightlight 328.Other examples of devices and/or systems that the control circuitry 334can communicate with include a system for controlling window blinds 330,one or more devices for detecting or controlling the states of one ormore doors 332 (such as detecting if a door is open, detecting if a dooris locked, or automatically locking a door), and a system forcontrolling a garage door 320 (e.g., control circuitry 334 integratedwith a garage door opener for identifying an open or closed state of thegarage door 320 and for causing the garage door opener to open or closethe garage door 320). Communications between the control circuitry 334of the bed 302 and other devices can occur through a network (e.g., aLAN or the Internet) or as point-to-point communication (e.g., usingBluetooth, radio communication, or a wired connection). In someimplementations, control circuitry 334 of different beds 302 cancommunicate with different sets of devices. For example, a kid bed maynot communicate with and/or control the same devices as an adult bed. Insome embodiments, the bed 302 can evolve with the age of the user suchthat the control circuitry 334 of the bed 302 communicates withdifferent devices as a function of age of the user.

The control circuitry 334 can receive information and inputs from otherdevices/systems and use the received information and inputs to controlactions of the bed 302 or other devices. For example, the controlcircuitry 334 can receive information from the thermostat 316 indicatinga current environmental temperature for a house or room in which the bed302 is located. The control circuitry 334 can use the receivedinformation (along with other information) to determine if a temperatureof all or a portion of the surface of the bed 302 should be raised orlowered. The control circuitry 334 can then cause a heating or coolingmechanism of the bed 302 to raise or lower the temperature of thesurface of the bed 302. For example, the user 308 can indicate a desiredsleeping temperature of 74 degrees while a second user of the bed 302indicates a desired sleeping temperature of 72 degrees. The thermostat316 can indicate to the control circuitry 334 that the currenttemperature of the bedroom is 72 degrees. The control circuitry 334 canidentify that the user 308 has indicated a desired sleeping temperatureof 74 degrees, and send control signals to a heating pad located on theuser 308's side of the bed to raise the temperature of the portion ofthe surface of the bed 302 where the user 308 is located to raise thetemperature of the user 308's sleeping surface to the desiredtemperature.

The control circuitry 334 can also generate control signals controllingother devices and propagate the control signals to the other devices. Insome implementations, the control signals are generated based oninformation collected by the control circuitry 334, includinginformation related to user interaction with the bed 302 by the user 308and/or one or more other users. In some implementations, informationcollected from one or more other devices other than the bed 302 are usedwhen generating the control signals. For example, information relatingto environmental occurrences (e.g., environmental temperature,environmental noise level, and environmental light level), time of day,time of year, day of the week, or other information can be used whengenerating control signals for various devices in communication with thecontrol circuitry 334 of the bed 302. For example, information on thetime of day can be combined with information relating to movement andbed presence of the user 308 to generate control signals for thelighting system 314. In some implementations, rather than or in additionto providing control signals for one or more other devices, the controlcircuitry 334 can provide collected information (e.g., informationrelated to user movement, bed presence, sleep state, or biometricsignals for the user 308) to one or more other devices to allow the oneor more other devices to utilize the collected information whengenerating control signals. For example, control circuitry 334 of thebed 302 can provide information relating to user interactions with thebed 302 by the user 308 to a central controller (not shown) that can usethe provided information to generate control signals for variousdevices, including the bed 302.

Still referring to FIG. 3, the control circuitry 334 of the bed 302 cangenerate control signals for controlling actions of other devices, andtransmit the control signals to the other devices in response toinformation collected by the control circuitry 334, including bedpresence of the user 308, sleep state of the user 308, and otherfactors. For example, control circuitry 334 integrated with the pump 304can detect a feature of a mattress of the bed 302, such as an increasein pressure in the air chamber 306 b, and use this detected increase inair pressure to determine that the user 308 is present on the bed 302.In some implementations, the control circuitry 334 can identify a heartrate or respiratory rate for the user 308 to identify that the increasein pressure is due to a person sitting, laying, or otherwise resting onthe bed 302 rather than an inanimate object (such as a suitcase) havingbeen placed on the bed 302. In some implementations, the informationindicating user bed presence is combined with other information toidentify a current or future likely state for the user 308. For example,a detected user bed presence at 11:00 am can indicate that the user issitting on the bed (e.g., to tie her shoes, or to read a book) and doesnot intend to go to sleep, while a detected user bed presence at 10:00pm can indicate that the user 308 is in bed for the evening and isintending to fall asleep soon. As another example, if the controlcircuitry 334 detects that the user 308 has left the bed 302 at 6:30 am(e.g., indicating that the user 308 has woken up for the day), and thenlater detects user bed presence of the user 308 at 7:30 am, the controlcircuitry 334 can use this information that the newly detected user bedpresence is likely temporary (e.g., while the user 308 ties her shoesbefore heading to work) rather than an indication that the user 308 isintending to stay on the bed 302 for an extended period.

In some implementations, the control circuitry 334 is able to usecollected information (including information related to user interactionwith the bed 302 by the user 308, as well as environmental information,time information, and input received from the user) to identify usepatterns for the user 308. For example, the control circuitry 334 canuse information indicating bed presence and sleep states for the user308 collected over a period of time to identify a sleep pattern for theuser. For example, the control circuitry 334 can identify that the user308 generally goes to bed between 9:30 pm and 10:00 pm, generally fallsasleep between 10:00 pm and 11:00 pm, and generally wakes up between6:30 am and 6:45 am based on information indicating user presence andbiometrics for the user 308 collected over a week. The control circuitry334 can use identified patterns for a user to better process andidentify user interactions with the bed 302 by the user 308.

For example, given the above example user bed presence, sleep, and wakepatterns for the user 308, if the user 308 is detected as being on thebed at 3:00 pm, the control circuitry 334 can determine that the user'spresence on the bed is only temporary, and use this determination togenerate different control signals than would be generated if thecontrol circuitry 334 determined that the user 308 was in bed for theevening. As another example, if the control circuitry 334 detects thatthe user 308 has gotten out of bed at 3:00 am, the control circuitry 334can use identified patterns for the user 308 to determine that the userhas only gotten up temporarily (for example, to use the rest room, orget a glass of water) and is not up for the day. By contrast, if thecontrol circuitry 334 identifies that the user 308 has gotten out of thebed 302 at 6:40 am, the control circuitry 334 can determine that theuser is up for the day and generate a different set of control signalsthan those that would be generated if it were determined that the user308 were only getting out of bed temporarily (as would be the case whenthe user 308 gets out of the bed 302 at 3:00 am). For other users 308,getting out of the bed 302 at 3:00 am can be the normal wake-up time,which the control circuitry 334 can learn and respond to accordingly.

As described above, the control circuitry 334 for the bed 302 cangenerate control signals for control functions of various other devices.The control signals can be generated, at least in part, based ondetected interactions by the user 308 with the bed 302, as well as otherinformation including time, date, temperature, etc. For example, thecontrol circuitry 334 can communicate with the television 312, receiveinformation from the television 312, and generate control signals forcontrolling functions of the television 312. For example, the controlcircuitry 334 can receive an indication from the television 312 that thetelevision 312 is currently on. If the television 312 is located in adifferent room from the bed 302, the control circuitry 334 can generatea control signal to turn the television 312 off upon making adetermination that the user 308 has gone to bed for the evening. Forexample, if bed presence of the user 308 on the bed 302 is detectedduring a particular time range (e.g., between 8:00 pm and 7:00 am) andpersists for longer than a threshold period of time (e.g., 10 minutes)the control circuitry 334 can use this information to determine that theuser 308 is in bed for the evening. If the television 312 is on (asindicated by communications received by the control circuitry 334 of thebed 302 from the television 312) the control circuitry 334 can generatea control signal to turn the television 312 off. The control signals canthen be transmitted to the television (e.g., through a directedcommunication link between the television 312 and the control circuitry334 or through a network). As another example, rather than turning offthe television 312 in response to detection of user bed presence, thecontrol circuitry 334 can generate a control signal that causes thevolume of the television 312 to be lowered by a pre-specified amount.

As another example, upon detecting that the user 308 has left the bed302 during a specified time range (e.g., between 6:00 am and 8:00 am)the control circuitry 334 can generate control signals to cause thetelevision 312 to turn on and tune to a pre-specified channel (e.g., theuser 308 has indicated a preference for watching the morning news upongetting out of bed in the morning). The control circuitry 334 cangenerate the control signal and transmit the signal to the television312 to cause the television 312 to turn on and tune to the desiredstation (which could be stored at the control circuitry 334, thetelevision 312, or another location). As another example, upon detectingthat the user 308 has gotten up for the day, the control circuitry 334can generate and transmit control signals to cause the television 312 toturn on and begin playing a previously recorded program from a digitalvideo recorder (DVR) in communication with the television 312.

As another example, if the television 312 is in the same room as the bed302, the control circuitry 334 does not cause the television 312 to turnoff in response to detection of user bed presence. Rather, the controlcircuitry 334 can generate and transmit control signals to cause thetelevision 312 to turn off in response to determining that the user 308is asleep. For example, the control circuitry 334 can monitor biometricsignals of the user 308 (e.g., motion, heart rate, respiration rate) todetermine that the user 308 has fallen asleep. Upon detecting that theuser 308 is sleeping, the control circuitry 334 generates and transmitsa control signal to turn the television 312 off. As another example, thecontrol circuitry 334 can generate the control signal to turn off thetelevision 312 after a threshold period of time after the user 308 hasfallen asleep (e.g., 10 minutes after the user has fallen asleep). Asanother example, the control circuitry 334 generates control signals tolower the volume of the television 312 after determining that the user308 is asleep. As yet another example, the control circuitry 334generates and transmits a control signal to cause the television togradually lower in volume over a period of time and then turn off inresponse to determining that the user 308 is asleep.

In some implementations, the control circuitry 334 can similarlyinteract with other media devices, such as computers, tablets, smartphones, stereo systems, etc. For example, upon detecting that the user308 is asleep, the control circuitry 334 can generate and transmit acontrol signal to the user device 310 to cause the user device 310 toturn off, or turn down the volume on a video or audio file being playedby the user device 310.

The control circuitry 334 can additionally communicate with the lightingsystem 314, receive information from the lighting system 314, andgenerate control signals for controlling functions of the lightingsystem 314. For example, upon detecting user bed presence on the bed 302during a certain time frame (e.g., between 8:00 pm and 7:00 am) thatlasts for longer than a threshold period of time (e.g., 10 minutes) thecontrol circuitry 334 of the bed 302 can determine that the user 308 isin bed for the evening. In response to this determination, the controlcircuitry 334 can generate control signals to cause lights in one ormore rooms other than the room in which the bed 302 is located to switchoff. The control signals can then be transmitted to the lighting system314 and executed by the lighting system 314 to cause the lights in theindicated rooms to shut off. For example, the control circuitry 334 cangenerate and transmit control signals to turn off lights in all commonrooms, but not in other bedrooms. As another example, the controlsignals generated by the control circuitry 334 can indicate that lightsin all rooms other than the room in which the bed 302 is located are tobe turned off, while one or more lights located outside of the housecontaining the bed 302 are to be turned on, in response to determiningthat the user 308 is in bed for the evening. Additionally, the controlcircuitry 334 can generate and transmit control signals to cause thenightlight 328 to turn on in response to determining user 308 bedpresence or whether the user 308 is asleep. As another example, thecontrol circuitry 334 can generate first control signals for turning offa first set of lights (e.g., lights in common rooms) in response todetecting user bed presence, and second control signals for turning offa second set of lights (e.g., lights in the room in which the bed 302 islocated) in response to detecting that the user 308 is asleep.

In some implementations, in response to determining that the user 308 isin bed for the evening, the control circuitry 334 of the bed 302 cangenerate control signals to cause the lighting system 314 to implement asunset lighting scheme in the room in which the bed 302 is located. Asunset lighting scheme can include, for example, dimming the lights(either gradually over time, or all at once) in combination withchanging the color of the light in the bedroom environment, such asadding an amber hue to the lighting in the bedroom. The sunset lightingscheme can help to put the user 308 to sleep when the control circuitry334 has determined that the user 308 is in bed for the evening.

The control circuitry 334 can also be configured to implement a sunriselighting scheme when the user 308 wakes up in the morning. The controlcircuitry 334 can determine that the user 308 is awake for the day, forexample, by detecting that the user 308 has gotten off of the bed 302(i.e., is no longer present on the bed 302) during a specified timeframe (e.g., between 6:00 am and 8:00 am). As another example, thecontrol circuitry 334 can monitor movement, heart rate, respiratoryrate, or other biometric signals of the user 308 to determine that theuser 308 is awake even though the user 308 has not gotten out of bed. Ifthe control circuitry 334 detects that the user is awake during aspecified time frame, the control circuitry 334 can determine that theuser 308 is awake for the day. The specified time frame can be, forexample, based on previously recorded user bed presence informationcollected over a period of time (e.g., two weeks) that indicates thatthe user 308 usually wakes up for the day between 6:30 am and 7:30 am.In response to the control circuitry 334 determining that the user 308is awake, the control circuitry 334 can generate control signals tocause the lighting system 314 to implement the sunrise lighting schemein the bedroom in which the bed 302 is located. The sunrise lightingscheme can include, for example, turning on lights (e.g., the lamp 326,or other lights in the bedroom). The sunrise lighting scheme can furtherinclude gradually increasing the level of light in the room where thebed 302 is located (or in one or more other rooms). The sunrise lightingscheme can also include only turning on lights of specified colors. Forexample, the sunrise lighting scheme can include lighting the bedroomwith blue light to gently assist the user 308 in waking up and becomingactive.

In some implementations, the control circuitry 334 can generatedifferent control signals for controlling actions of one or morecomponents, such as the lighting system 314, depending on a time of daythat user interactions with the bed 302 are detected. For example, thecontrol circuitry 334 can use historical user interaction informationfor interactions between the user 308 and the bed 302 to determine thatthe user 308 usually falls asleep between 10:00 pm and 11:00 pm andusually wakes up between 6:30 am and 7:30 am on weekdays. The controlcircuitry 334 can use this information to generate a first set ofcontrol signals for controlling the lighting system 314 if the user 308is detected as getting out of bed at 3:00 am and to generate a secondset of control signals for controlling the lighting system 314 if theuser 308 is detected as getting out of bed after 6:30 am. For example,if the user 308 gets out of bed prior to 6:30 am, the control circuitry334 can turn on lights that guide the user 308's route to a restroom. Asanother example, if the user 308 gets out of bed prior to 6:30 am, thecontrol circuitry 334 can turn on lights that guide the user 308's routeto the kitchen (which can include, for example, turning on thenightlight 328, turning on under bed lighting, or turning on the lamp326).

As another example, if the user 308 gets out of bed after 6:30 am, thecontrol circuitry 334 can generate control signals to cause the lightingsystem 314 to initiate a sunrise lighting scheme, or to turn on one ormore lights in the bedroom and/or other rooms. In some implementations,if the user 308 is detected as getting out of bed prior to a specifiedmorning rise time for the user 308, the control circuitry 334 causes thelighting system 314 to turn on lights that are dimmer than lights thatare turned on by the lighting system 314 if the user 308 is detected asgetting out of bed after the specified morning rise time. Causing thelighting system 314 to only turn on dim lights when the user 308 getsout of bed during the night (i.e., prior to normal rise time for theuser 308) can prevent other occupants of the house from being woken bythe lights while still allowing the user 308 to see in order to reachthe restroom, kitchen, or another destination within the house.

The historical user interaction information for interactions between theuser 308 and the bed 302 can be used to identify user sleep and awaketime frames. For example, user bed presence times and sleep times can bedetermined for a set period of time (e.g., two weeks, a month, etc.).The control circuitry 334 can then identify a typical time range or timeframe in which the user 308 goes to bed, a typical time frame for whenthe user 308 falls asleep, and a typical time frame for when the user308 wakes up (and in some cases, different time frames for when the user308 wakes up and when the user 308 actually gets out of bed). In someimplementations, buffer time can be added to these time frames. Forexample, if the user is identified as typically going to bed between10:00 pm and 10:30 pm, a buffer of a half hour in each direction can beadded to the time frame such that any detection of the user getting ontothe bed between 9:30 pm and 11:00 pm is interpreted as the user 308going to bed for the evening. As another example, detection of bedpresence of the user 308 starting from a half hour before the earliesttypical time that the user 308 goes to bed extending until the typicalwake up time (e.g., 6:30 am) for the user can be interpreted as the usergoing to bed for the evening. For example, if the user typically goes tobed between 10:00 pm and 10:30 pm, if the user's bed presence is sensedat 12:30 am one night, that can be interpreted as the user getting intobed for the evening even though this is outside of the user's typicaltime frame for going to bed because it has occurred prior to the user'snormal wake up time. In some implementations, different time frames areidentified for different times of the year (e.g., earlier bed timeduring winter vs. summer) or at different times of the week (e.g., userwakes up earlier on weekdays than on weekends).

The control circuitry 334 can distinguish between the user 308 going tobed for an extended period (such as for the night) as opposed to beingpresent on the bed 302 for a shorter period (such as for a nap) bysensing duration of presence of the user 308. In some examples, thecontrol circuitry 334 can distinguish between the user 308 going to bedfor an extended period (such as for the night) as opposed to going tobed for a shorter period (such as for a nap) by sensing duration ofsleep of the user 308. For example, the control circuitry 334 can set atime threshold whereby if the user 308 is sensed on the bed 302 forlonger than the threshold, the user 308 is considered to have gone tobed for the night. In some examples, the threshold can be about 2 hours,whereby if the user 308 is sensed on the bed 302 for greater than 2hours, the control circuitry 334 registers that as an extended sleepevent. In other examples, the threshold can be greater than or less thantwo hours.

The control circuitry 334 can detect repeated extended sleep events todetermine a typical bed time range of the user 308 automatically,without requiring the user 308 to enter a bed time range. This can allowthe control circuitry 334 to accurately estimate when the user 308 islikely to go to bed for an extended sleep event, regardless of whetherthe user 308 typically goes to bed using a traditional sleep schedule ora non-traditional sleep schedule. The control circuitry 334 can then useknowledge of the bed time range of the user 308 to control one or morecomponents (including components of the bed 302 and/or non-bedperipherals) differently based on sensing bed presence during the bedtime range or outside of the bed time range.

In some examples, the control circuitry 334 can automatically determinethe bed time range of the user 308 without requiring user inputs. Insome examples, the control circuitry 334 can determine the bed timerange of the user 308 automatically and in combination with user inputs.In some examples, the control circuitry 334 can set the bed time rangedirectly according to user inputs. In some examples, the controlcircuity 334 can associate different bed times with different days ofthe week. In each of these examples, the control circuitry 334 cancontrol one or more components (such as the lighting system 314, thethermostat 316, the security system 318, the oven 322, the coffee maker324, the lamp 326, and the nightlight 328), as a function of sensed bedpresence and the bed time range.

The control circuitry 334 can additionally communicate with thethermostat 316, receive information from the thermostat 316, andgenerate control signals for controlling functions of the thermostat316. For example, the user 308 can indicate user preferences fordifferent temperatures at different times, depending on the sleep stateor bed presence of the user 308. For example, the user 308 may prefer anenvironmental temperature of 72 degrees when out of bed, 70 degrees whenin bed but awake, and 68 degrees when sleeping. The control circuitry334 of the bed 302 can detect bed presence of the user 308 in theevening and determine that the user 308 is in bed for the night. Inresponse to this determination, the control circuitry 334 can generatecontrol signals to cause the thermostat to change the temperature to 70degrees. The control circuitry 334 can then transmit the control signalsto the thermostat 316. Upon detecting that the user 308 is in bed duringthe bed time range or asleep, the control circuitry 334 can generate andtransmit control signals to cause the thermostat 316 to change thetemperature to 68. The next morning, upon determining that the user isawake for the day (e.g., the user 308 gets out of bed after 6:30 am) thecontrol circuitry 334 can generate and transmit control circuitry 334 tocause the thermostat to change the temperature to 72 degrees.

In some implementations, the control circuitry 334 can similarlygenerate control signals to cause one or more heating or coolingelements on the surface of the bed 302 to change temperature at varioustimes, either in response to user interaction with the bed 302 or atvarious pre-programmed times. For example, the control circuitry 334 canactivate a heating element to raise the temperature of one side of thesurface of the bed 302 to 73 degrees when it is detected that the user308 has fallen asleep. As another example, upon determining that theuser 308 is up for the day, the control circuitry 334 can turn off aheating or cooling element. As yet another example, the user 308 canpre-program various times at which the temperature at the surface of thebed should be raised or lowered. For example, the user can program thebed 302 to raise the surface temperature to 76 degrees at 10:00 pm, andlower the surface temperature to 68 degrees at 11:30 pm.

In some implementations, in response to detecting user bed presence ofthe user 308 and/or that the user 308 is asleep, the control circuitry334 can cause the thermostat 316 to change the temperature in differentrooms to different values. For example, in response to determining thatthe user 308 is in bed for the evening, the control circuitry 334 cangenerate and transmit control signals to cause the thermostat 316 to setthe temperature in one or more bedrooms of the house to 72 degrees andset the temperature in other rooms to 67 degrees.

The control circuitry 334 can also receive temperature information fromthe thermostat 316 and use this temperature information to controlfunctions of the bed 302 or other devices. For example, as discussedabove, the control circuitry 334 can adjust temperatures of heatingelements included in the bed 302 in response to temperature informationreceived from the thermostat 316.

In some implementations, the control circuitry 334 can generate andtransmit control signals for controlling other temperature controlsystems. For example, in response to determining that the user 308 isawake for the day, the control circuitry 334 can generate and transmitcontrol signals for causing floor heating elements to activate. Forexample, the control circuitry 334 can cause a floor heating system fora master bedroom to turn on in response to determining that the user 308is awake for the day.

The control circuitry 334 can additionally communicate with the securitysystem 318, receive information from the security system 318, andgenerate control signals for controlling functions of the securitysystem 318. For example, in response to detecting that the user 308 inis bed for the evening, the control circuitry 334 can generate controlsignals to cause the security system to engage or disengage securityfunctions. The control circuitry 334 can then transmit the controlsignals to the security system 318 to cause the security system 318 toengage. As another example, the control circuitry 334 can generate andtransmit control signals to cause the security system 318 to disable inresponse to determining that the user 308 is awake for the day (e.g.,user 308 is no longer present on the bed 302 after 6:00 am). In someimplementations, the control circuitry 334 can generate and transmit afirst set of control signals to cause the security system 318 to engagea first set of security features in response to detecting user bedpresence of the user 308, and can generate and transmit a second set ofcontrol signals to cause the security system 318 to engage a second setof security features in response to detecting that the user 308 hasfallen asleep.

In some implementations, the control circuitry 334 can receive alertsfrom the security system 318 (and/or a cloud service associated with thesecurity system 318) and indicate the alert to the user 308. Forexample, the control circuitry 334 can detect that the user 308 is inbed for the evening and in response, generate and transmit controlsignals to cause the security system 318 to engage or disengage. Thesecurity system can then detect a security breach (e.g., someone hasopened the door 332 without entering the security code, or someone hasopened a window when the security system 318 is engaged). The securitysystem 318 can communicate the security breach to the control circuitry334 of the bed 302. In response to receiving the communication from thesecurity system 318, the control circuitry 334 can generate controlsignals to alert the user 308 to the security breach. For example, thecontrol circuitry 334 can cause the bed 302 to vibrate. As anotherexample, the control circuitry 334 can cause portions of the bed 302 toarticulate (e.g., cause the head section to raise or lower) in order towake the user 308 and alert the user to the security breach. As anotherexample, the control circuitry 334 can generate and transmit controlsignals to cause the lamp 326 to flash on and off at regular intervalsto alert the user 308 to the security breach. As another example, thecontrol circuitry 334 can alert the user 308 of one bed 302 regarding asecurity breach in a bedroom of another bed, such as an open window in akid's bedroom. As another example, the control circuitry 334 can send analert to a garage door controller (e.g., to close and lock the door). Asanother example, the control circuitry 334 can send an alert for thesecurity to be disengaged.

The control circuitry 334 can additionally generate and transmit controlsignals for controlling the garage door 320 and receive informationindicating a state of the garage door 320 (i.e., open or closed). Forexample, in response to determining that the user 308 is in bed for theevening, the control circuitry 334 can generate and transmit a requestto a garage door opener or another device capable of sensing if thegarage door 320 is open. The control circuitry 334 can requestinformation on the current state of the garage door 320. If the controlcircuitry 334 receives a response (e.g., from the garage door opener)indicating that the garage door 320 is open, the control circuitry 334can either notify the user 308 that the garage door is open, or generatea control signal to cause the garage door opener to close the garagedoor 320. For example, the control circuitry 334 can send a message tothe user device 310 indicating that the garage door is open. As anotherexample, the control circuitry 334 can cause the bed 302 to vibrate. Asyet another example, the control circuitry 334 can generate and transmita control signal to cause the lighting system 314 to cause one or morelights in the bedroom to flash to alert the user 308 to check the userdevice 310 for an alert (in this example, an alert regarding the garagedoor 320 being open). Alternatively, or additionally, the controlcircuitry 334 can generate and transmit control signals to cause thegarage door opener to close the garage door 320 in response toidentifying that the user 308 is in bed for the evening and that thegarage door 320 is open. In some implementations, control signals canvary depend on the age of the user 308.

The control circuitry 334 can similarly send and receive communicationsfor controlling or receiving state information associated with the door332 or the oven 322. For example, upon detecting that the user 308 is inbed for the evening, the control circuitry 334 can generate and transmita request to a device or system for detecting a state of the door 332.Information returned in response to the request can indicate variousstates for the door 332 such as open, closed but unlocked, or closed andlocked. If the door 332 is open or closed but unlocked, the controlcircuitry 334 can alert the user 308 to the state of the door, such asin a manner described above with reference to the garage door 320.Alternatively, or in addition to alerting the user 308, the controlcircuitry 334 can generate and transmit control signals to cause thedoor 332 to lock, or to close and lock. If the door 332 is closed andlocked, the control circuitry 334 can determine that no further actionis needed.

Similarly, upon detecting that the user 308 is in bed for the evening,the control circuitry 334 can generate and transmit a request to theoven 322 to request a state of the oven 322 (e.g., on or off). If theoven 322 is on, the control circuitry 334 can alert the user 308 and/orgenerate and transmit control signals to cause the oven 322 to turn offIf the oven is already off, the control circuitry 334 can determine thatno further action is necessary. In some implementations, differentalerts can be generated for different events. For example, the controlcircuitry 334 can cause the lamp 326 (or one or more other lights, viathe lighting system 314) to flash in a first pattern if the securitysystem 318 has detected a breach, flash in a second pattern if garagedoor 320 is on, flash in a third pattern if the door 332 is open, flashin a fourth pattern if the oven 322 is on, and flash in a fifth patternif another bed has detected that a user of that bed has gotten up (e.g.,that a child of the user 308 has gotten out of bed in the middle of thenight as sensed by a sensor in the bed 302 of the child). Other examplesof alerts that can be processed by the control circuitry 334 of the bed302 and communicated to the user include a smoke detector detectingsmoke (and communicating this detection of smoke to the controlcircuitry 334), a carbon monoxide tester detecting carbon monoxide, aheater malfunctioning, or an alert from any other device capable ofcommunicating with the control circuitry 334 and detecting an occurrencethat should be brought to the user 308's attention.

The control circuitry 334 can also communicate with a system or devicefor controlling a state of the window blinds 330. For example, inresponse to determining that the user 308 is in bed for the evening, thecontrol circuitry 334 can generate and transmit control signals to causethe window blinds 330 to close. As another example, in response todetermining that the user 308 is up for the day (e.g., user has gottenout of bed after 6:30 am) the control circuitry 334 can generate andtransmit control signals to cause the window blinds 330 to open. Bycontrast, if the user 308 gets out of bed prior to a normal rise timefor the user 308, the control circuitry 334 can determine that the user308 is not awake for the day and does not generate control signals forcausing the window blinds 330 to open. As yet another example, thecontrol circuitry 334 can generate and transmit control signals thatcause a first set of blinds to close in response to detecting user bedpresence of the user 308 and a second set of blinds to close in responseto detecting that the user 308 is asleep.

The control circuitry 334 can generate and transmit control signals forcontrolling functions of other household devices in response todetecting user interactions with the bed 302. For example, in responseto determining that the user 308 is awake for the day, the controlcircuitry 334 can generate and transmit control signals to the coffeemaker 324 to cause the coffee maker 324 to begin brewing coffee. Asanother example, the control circuitry 334 can generate and transmitcontrol signals to the oven 322 to cause the oven to begin preheating(for users that like fresh baked bread in the morning). As anotherexample, the control circuitry 334 can use information indicating thatthe user 308 is awake for the day along with information indicating thatthe time of year is currently winter and/or that the outside temperatureis below a threshold value to generate and transmit control signals tocause a car engine block heater to turn on.

As another example, the control circuitry 334 can generate and transmitcontrol signals to cause one or more devices to enter a sleep mode inresponse to detecting user bed presence of the user 308, or in responseto detecting that the user 308 is asleep. For example, the controlcircuitry 334 can generate control signals to cause a mobile phone ofthe user 308 to switch into sleep mode. The control circuitry 334 canthen transmit the control signals to the mobile phone. Later, upondetermining that the user 308 is up for the day, the control circuitry334 can generate and transmit control signals to cause the mobile phoneto switch out of sleep mode.

In some implementations, the control circuitry 334 can communicate withone or more noise control devices. For example, upon determining thatthe user 308 is in bed for the evening, or that the user 308 is asleep,the control circuitry 334 can generate and transmit control signals tocause one or more noise cancelation devices to activate. The noisecancelation devices can, for example, be included as part of the bed 302or located in the bedroom with the bed 302. As another example, upondetermining that the user 308 is in bed for the evening or that the user308 is asleep, the control circuitry 334 can generate and transmitcontrol signals to turn the volume on, off, up, or down, for one or moresound generating devices, such as a stereo system radio, computer,tablet, etc.

Additionally, functions of the bed 302 are controlled by the controlcircuitry 334 in response to user interactions with the bed 302. Forexample, the bed 302 can include an adjustable foundation and anarticulation controller configured to adjust the position of one or moreportions of the bed 302 by adjusting the adjustable foundation thatsupports the bed. For example, the articulation controller can adjustthe bed 302 from a flat position to a position in which a head portionof a mattress of the bed 302 is inclined upward (e.g., to facilitate auser sitting up in bed and/or watching television). In someimplementations, the bed 302 includes multiple separately articulablesections. For example, portions of the bed corresponding to thelocations of the air chambers 306 a and 306 b can be articulatedindependently from each other, to allow one person positioned on the bed302 surface to rest in a first position (e.g., a flat position) while asecond person rests in a second position (e.g., a reclining positionwith the head raised at an angle from the waist). In someimplementations, separate positions can be set for two different beds(e.g., two twin beds placed next to each other). The foundation of thebed 302 can include more than one zone that can be independentlyadjusted. The articulation controller can also be configured to providedifferent levels of massage to one or more users on the bed 302 or tocause the bed to vibrate to communicate alerts to the user 308 asdescribed above.

The control circuitry 334 can adjust positions (e.g., incline anddecline positions for the user 308 and/or an additional user of the bed302) in response to user interactions with the bed 302. For example, thecontrol circuitry 334 can cause the articulation controller to adjustthe bed 302 to a first recline position for the user 308 in response tosensing user bed presence for the user 308. The control circuitry 334can cause the articulation controller to adjust the bed 302 to a secondrecline position (e.g., a less reclined, or flat position) in responseto determining that the user 308 is asleep. As another example, thecontrol circuitry 334 can receive a communication from the television312 indicating that the user 308 has turned off the television 312, andin response the control circuitry 334 can cause the articulationcontroller to adjust the position of the bed 302 to a preferred usersleeping position (e.g., due to the user turning off the television 312while the user 308 is in bed indicating that the user 308 wishes to goto sleep).

In some implementations, the control circuitry 334 can control thearticulation controller so as to wake up one user of the bed 302 withoutwaking another user of the bed 302. For example, the user 308 and asecond user of the bed 302 can each set distinct wakeup times (e.g.,6:30 am and 7:15 am respectively). When the wakeup time for the user 308is reached, the control circuitry 334 can cause the articulationcontroller to vibrate or change the position of only a side of the bedon which the user 308 is located to wake the user 308 without disturbingthe second user. When the wakeup time for the second user is reached,the control circuitry 334 can cause the articulation controller tovibrate or change the position of only the side of the bed on which thesecond user is located. Alternatively, when the second wakeup timeoccurs, the control circuitry 334 can utilize other methods (such asaudio alarms, or turning on the lights) to wake the second user sincethe user 308 is already awake and therefore will not be disturbed whenthe control circuitry 334 attempts to wake the second user.

Still referring to FIG. 3, the control circuitry 334 for the bed 302 canutilize information for interactions with the bed 302 by multiple usersto generate control signals for controlling functions of various otherdevices. For example, the control circuitry 334 can wait to generatecontrol signals for, for example, engaging the security system 318, orinstructing the lighting system 314 to turn off lights in various roomsuntil both the user 308 and a second user are detected as being presenton the bed 302. As another example, the control circuitry 334 cangenerate a first set of control signals to cause the lighting system 314to turn off a first set of lights upon detecting bed presence of theuser 308 and generate a second set of control signals for turning off asecond set of lights in response to detecting bed presence of a seconduser. As another example, the control circuitry 334 can wait until ithas been determined that both the user 308 and a second user are awakefor the day before generating control signals to open the window blinds330. As yet another example, in response to determining that the user308 has left the bed and is awake for the day, but that a second user isstill sleeping, the control circuitry 334 can generate and transmit afirst set of control signals to cause the coffee maker 324 to beginbrewing coffee, to cause the security system 318 to deactivate, to turnon the lamp 326, to turn off the nightlight 328, to cause the thermostat316 to raise the temperature in one or more rooms to 72 degrees, and toopen blinds (e.g., the window blinds 330) in rooms other than thebedroom in which the bed 302 is located. Later, in response to detectingthat the second user is no longer present on the bed (or that the seconduser is awake) the control circuitry 334 can generate and transmit asecond set of control signals to, for example, cause the lighting system314 to turn on one or more lights in the bedroom, to cause window blindsin the bedroom to open, and to turn on the television 312 to apre-specified channel.

Examples of Data Processing Systems Associated with a Bed

Described here are examples of systems and components that can be usedfor data processing tasks that are, for example, associated with a bed.In some cases, multiple examples of a particular component or group ofcomponents are presented. Some of these examples are redundant and/ormutually exclusive alternatives. Connections between components areshown as examples to illustrate possible network configurations forallowing communication between components. Different formats ofconnections can be used as technically needed or desired. Theconnections generally indicate a logical connection that can be createdwith any technologically feasible format. For example, a network on amotherboard can be created with a printed circuit board, wireless dataconnections, and/or other types of network connections. Some logicalconnections are not shown for clarity. For example, connections withpower supplies and/or computer readable memory may not be shown forclarities sake, as many or all elements of a particular component mayneed to be connected to the power supplies and/or computer readablememory.

FIG. 4A is a block diagram of an example of a data processing system 400that can be associated with a bed system, including those describedabove with respect to FIGS. 1-3. This system 400 includes a pumpmotherboard 402 and a pump daughterboard 404. The system 400 includes asensor array 406 that can include one or more sensors configured tosense physical phenomenon of the environment and/or bed, and to reportsuch sensing back to the pump motherboard 402 for, for example,analysis. The system 400 also includes a controller array 408 that caninclude one or more controllers configured to control logic-controlleddevices of the bed and/or environment. The pump motherboard 400 can bein communication with one or more computing devices 414 and one or morecloud services 410 over local networks, the Internet 412, or otherwiseas is technically appropriate. Each of these components will bedescribed in more detail, some with multiple example configurations,below.

In this example, a pump motherboard 402 and a pump daughterboard 404 arecommunicably coupled. They can be conceptually described as a center orhub of the system 400, with the other components conceptually describedas spokes of the system 400. In some configurations, this can mean thateach of the spoke components communicates primarily or exclusively withthe pump motherboard 402. For example, a sensor of the sensor array maynot be configured to, or may not be able to, communicate directly with acorresponding controller. Instead, each spoke component can communicatewith the motherboard 402. The sensor of the sensor array 406 can reporta sensor reading to the motherboard 402, and the motherboard 402 candetermine that, in response, a controller of the controller array 408should adjust some parameters of a logic controlled device or otherwisemodify a state of one or more peripheral devices. In one case, if thetemperature of the bed is determined to be too hot, the pump motherboard402 can determine that a temperature controller should cool the bed.

One advantage of a hub-and-spoke network configuration, sometimes alsoreferred to as a star-shaped network, is a reduction in network trafficcompared to, for example, a mesh network with dynamic routing. If aparticular sensor generates a large, continuous stream of traffic, thattraffic may only be transmitted over one spoke of the network to themotherboard 402. The motherboard 402 can, for example, marshal that dataand condense it to a smaller data format for retransmission for storagein a cloud service 410. Additionally or alternatively, the motherboard402 can generate a single, small, command message to be sent down adifferent spoke of the network in response to the large stream. Forexample, if the large stream of data is a pressure reading that istransmitted from the sensor array 406 a few times a second, themotherboard 402 can respond with a single command message to thecontroller array to increase the pressure in an air chamber. In thiscase, the single command message can be orders of magnitude smaller thanthe stream of pressure readings.

As another advantage, a hub-and-spoke network configuration can allowfor an extensible network that can accommodate components being added,removed, failing, etc. This can allow, for example, more, fewer, ordifferent sensors in the sensor array 406, controllers in the controllerarray 408, computing devices 414, and/or cloud services 410. Forexample, if a particular sensor fails or is deprecated by a newerversion of the sensor, the system 400 can be configured such that onlythe motherboard 402 needs to be updated about the replacement sensor.This can allow, for example, product differentiation where the samemotherboard 402 can support an entry level product with fewer sensorsand controllers, a higher value product with more sensors andcontrollers, and customer personalization where a customer can add theirown selected components to the system 400.

Additionally, a line of air bed products can use the system 400 withdifferent components. In an application in which every air bed in theproduct line includes both a central logic unit and a pump, themotherboard 402 (and optionally the daughterboard 404) can be designedto fit within a single, universal housing. Then, for each upgrade of theproduct in the product line, additional sensors, controllers, cloudservices, etc., can be added. Design, manufacturing, and testing timecan be reduced by designing all products in a product line from thisbase, compared to a product line in which each product has a bespokelogic control system.

Each of the components discussed above can be realized in a wide varietyof technologies and configurations. Below, some examples of eachcomponent will be further discussed. In some alternatives, two or moreof the components of the system 400 can be realized in a singlealternative component; some components can be realized in multiple,separate components; and/or some functionality can be provided bydifferent components.

FIG. 4B is a block diagram showing some communication paths of the dataprocessing system 400. As previously described, the motherboard 402 andthe pump daughterboard 404 may act as a hub for peripheral devices andcloud services of the system 400. In cases in which the pumpdaughterboard 404 communicates with cloud services or other components,communications from the pump daughterboard 404 may be routed through thepump motherboard 402. This may allow, for example, the bed to have onlya single connection with the internet 412. The computing device 414 mayalso have a connection to the internet 412, possibly through the samegateway used by the bed and/or possibly through a different gateway(e.g., a cell service provider).

Previously, a number of cloud services 410 were described. As shown inFIG. 4B, some cloud services, such as cloud services 410 d and 410 e,may be configured such that the pump motherboard 402 can communicatewith the cloud service directly—that is the motherboard 402 maycommunicate with a cloud service 410 without having to use another cloudservice 410 as an intermediary. Additionally or alternatively, somecloud services 410, for example cloud service 410 f, may only bereachable by the pump motherboard 402 through an intermediary cloudservice, for example cloud service 410 e. While not shown here, somecloud services 410 may be reachable either directly or indirectly by thepump motherboard 402.

Additionally, some or all of the cloud services 410 may be configured tocommunicate with other cloud services. This communication may includethe transfer of data and/or remote function calls according to anytechnologically appropriate format. For example, one cloud service 410may request a copy for another cloud service's 410 data, for example,for purposes of backup, coordination, migration, or for performance ofcalculations or data mining. In another example, many cloud services 410may contain data that is indexed according to specific users tracked bythe user account cloud 410 c and/or the bed data cloud 410 a. Thesecloud services 410 may communicate with the user account cloud 410 cand/or the bed data cloud 410 a when accessing data specific to aparticular user or bed.

FIG. 5 is a block diagram of an example of a motherboard 402 that can beused in a data processing system that can be associated with a bedsystem, including those described above with respect to FIGS. 1-3. Inthis example, compared to other examples described below, thismotherboard 402 consists of relatively fewer parts and can be limited toprovide a relatively limited feature set.

The motherboard includes a power supply 500, a processor 502, andcomputer memory 512. In general, the power supply includes hardware usedto receive electrical power from an outside source and supply it tocomponents of the motherboard 402. The power supply can include, forexample, a battery pack and/or wall outlet adapter, an AC to DCconverter, a DC to AC converter, a power conditioner, a capacitor bank,and/or one or more interfaces for providing power in the current type,voltage, etc., needed by other components of the motherboard 402.

The processor 502 is generally a device for receiving input, performinglogical determinations, and providing output. The processor 502 can be acentral processing unit, a microprocessor, general purpose logiccircuity, application-specific integrated circuity, a combination ofthese, and/or other hardware for performing the functionality needed.

The memory 512 is generally one or more devices for storing data. Thememory 512 can include long term stable data storage (e.g., on a harddisk), short term unstable (e.g., on Random Access Memory) or any othertechnologically appropriate configuration.

The motherboard 402 includes a pump controller 504 and a pump motor 506.The pump controller 504 can receive commands from the processor 502 and,in response, control the function of the pump motor 506. For example,the pump controller 504 can receive, from the processor 502, a commandto increase the pressure of an air chamber by 0.3 pounds per square inch(PSI). The pump controller 504, in response, engages a valve so that thepump motor 506 is configured to pump air into the selected air chamber,and can engage the pump motor 506 for a length of time that correspondsto 0.3 PSI or until a sensor indicates that pressure has been increasedby 0.3 PSI. In an alternative configuration, the message can specifythat the chamber should be inflated to a target PSI, and the pumpcontroller 504 can engage the pump motor 506 until the target PSI isreached.

A valve solenoid 508 can control which air chamber a pump is connectedto. In some cases, the solenoid 508 can be controlled by the processor502 directly. In some cases, the solenoid 508 can be controlled by thepump controller 504.

A remote interface 510 of the motherboard 402 can allow the motherboard402 to communicate with other components of a data processing system.For example, the motherboard 402 can be able to communicate with one ormore daughterboards, with peripheral sensors, and/or with peripheralcontrollers through the remote interface 510. The remote interface 510can provide any technologically appropriate communication interface,including but not limited to multiple communication interfaces such asWiFi, Bluetooth, and copper wired networks.

FIG. 6 is a block diagram of an example of a motherboard 402 that can beused in a data processing system that can be associated with a bedsystem, including those described above with respect to FIGS. 1-3.Compared to the motherboard 402 described with reference to FIG. 5, themotherboard in FIG. 6 can contain more components and provide morefunctionality in some applications.

In addition to the power supply 500, processor 502, pump controller 504,pump motor 506, and valve solenoid 508, this motherboard 402 is shownwith a valve controller 600, a pressure sensor 602, a universal serialbus (USB) stack 604, a WiFi radio 606, a Bluetooth Low Energy (BLE)radio 608, a ZigBee radio 610, a Bluetooth radio 612 and a computermemory 512.

Similar to the way that the pump controller 504 converts commands fromthe processor 502 into control signals for the pump motor 506, the valvecontroller 600 can convert commands from the processor 502 into controlsignals for the valve solenoid 508. In one example, the processor 502can issue a command to the valve controller 600 to connect the pump to aparticular air chamber out of the group of air chambers in an air bed.The valve controller 600 can control the position of the valve solenoid508 so that the pump is connected to the indicated air chamber.

The pressure sensor 602 can read pressure readings from one or more airchambers of the air bed. The pressure sensor 602 can also preformdigital sensor conditioning.

The motherboard 402 can include a suite of network interfaces, includingbut not limited to those shown here. These network interfaces can allowthe motherboard to communicate over a wired or wireless network with anynumber of devices, including but not limited to peripheral sensors,peripheral controllers, computing devices, and devices and servicesconnected to the Internet 412.

FIG. 7 is a block diagram of an example of a daughterboard 404 that canbe used in a data processing system that can be associated with a bedsystem, including those described above with respect to FIGS. 1-3. Insome configurations, one or more daughterboards 404 can be connected tothe motherboard 402. Some daughterboards 404 can be designed to offloadparticular and/or compartmentalized tasks from the motherboard 402. Thiscan be advantageous, for example, if the particular tasks arecomputationally intensive, proprietary, or subject to future revisions.For example, the daughterboard 404 can be used to calculate a particularsleep data metric. This metric can be computationally intensive, andcalculating the sleep metric on the daughterboard 404 can free up theresources of the motherboard 402 while the metric is being calculated.Additionally and/or alternatively, the sleep metric can be subject tofuture revisions. To update the system 400 with the new sleep metric, itis possible that only the daughterboard 404 that calculates that metricneed be replaced. In this case, the same motherboard 402 and othercomponents can be used, saving the need to perform unit testing ofadditional components instead of just the daughterboard 404.

The daughterboard 404 is shown with a power supply 700, a processor 702,computer readable memory 704, a pressure sensor 706, and a WiFi radio708. The processor can use the pressure sensor 706 to gather informationabout the pressure of the air chamber or chambers of an air bed. Fromthis data, the processor 702 can perform an algorithm to calculate asleep metric. In some examples, the sleep metric can be calculated fromonly the pressure of air chambers. In other examples, the sleep metriccan be calculated from one or more other sensors. In an example in whichdifferent data is needed, the processor 702 can receive that data froman appropriate sensor or sensors. These sensors can be internal to thedaughterboard 404, accessible via the WiFi radio 708, or otherwise incommunication with the processor 702. Once the sleep metric iscalculated, the processor 702 can report that sleep metric to, forexample, the motherboard 402.

FIG. 8 is a block diagram of an example of a motherboard 800 with nodaughterboard that can be used in a data processing system that can beassociated with a bed system, including those described above withrespect to FIGS. 1-3. In this example, the motherboard 800 can performmost, all, or more of the features described with reference to themotherboard 402 in FIG. 6 and the daughterboard 404 in FIG. 7.

FIG. 9 is a block diagram of an example of a sensory array 406 that canbe used in a data processing system that can be associated with a bedsystem, including those described above with respect to FIGS. 1-3. Ingeneral, the sensor array 406 is a conceptual grouping of some or allthe peripheral sensors that communicate with the motherboard 402 but arenot native to the motherboard 402.

The peripheral sensors of the sensor array 406 can communicate with themotherboard 402 through one or more of the network interfaces of themotherboard, including but not limited to the USB stack 1112, a WiFiradio 606, a Bluetooth Low Energy (BLE) radio 608, a ZigBee radio 610,and a Bluetooth radio 612, as is appropriate for the configuration ofthe particular sensor. For example, a sensor that outputs a reading overa USB cable can communicate through the USB stack 1112.

Some of the peripheral sensors 900 of the sensor array 406 can be bedmounted 900. These sensors can be, for example, embedded into thestructure of a bed and sold with the bed, or later affixed to thestructure of the bed. Other peripheral sensors 902 and 904 can be incommunication with the motherboard 402, but optionally not mounted tothe bed. In some cases, some or all of the bed mounted sensors 900and/or peripheral sensors 902 and 904 can share networking hardware,including a conduit that contains wires from each sensor, a multi-wirecable or plug that, when affixed to the motherboard 402, connect all ofthe associated sensors with the motherboard 402. In some embodiments,one, some, or all of sensors 902, 904, 906, 908, and 910 can sense oneor more features of a mattress, such as pressure, temperature, light,sound, and/or one or more other features of the mattress. In someembodiments, one, some, or all of sensors 902, 904, 906, 908, and 910can sense one or more features external to the mattress. In someembodiments, pressure sensor 902 can sense pressure of the mattresswhile some or all of sensors 902, 904, 906, 908, and 910 can sense oneor more features of the mattress and/or external to the mattress.

FIG. 10 is a block diagram of an example of a controller array 408 thatcan be used in a data processing system that can be associated with abed system, including those described above with respect to FIGS. 1-3.In general, the controller array 408 is a conceptual grouping of some orall peripheral controllers that communicate with the motherboard 402 butare not native to the motherboard 402.

The peripheral controllers of the controller array 408 can communicatewith the motherboard 402 through one or more of the network interfacesof the motherboard, including but not limited to the USB stack 1112, aWiFi radio 1114, a Bluetooth Low Energy (BLE) radio 1116, a ZigBee radio610, and a Bluetooth radio 612, as is appropriate for the configurationof the particular sensor. For example, a controller that receives acommand over a USB cable can communicate through the USB stack 1112.

Some of the controllers of the controller array 408 can be bed mounted1000, including but not limited to a temperature controller 1006, alight controller 1008, and/or a speaker controller 1010. Thesecontrollers can be, for example, embedded into the structure of a bedand sold with the bed, or later affixed to the structure of the bed.Other peripheral controllers 1002 and 1004 can be in communication withthe motherboard 402, but optionally not mounted to the bed. In somecases, some or all of the bed mounted controllers 1000 and/or peripheralcontrollers 1002 and 1004 can share networking hardware, including aconduit that contains wires for each controller, a multi-wire cable orplug that, when affixed to the motherboard 402, connects all of theassociated controllers with the motherboard 402.

FIG. 11 is a block diagram of an example of a computing device 414 thatcan be used in a data processing system that can be associated with abed system, including those described above with respect to FIGS. 1-3.The computing device 414 can include, for example, computing devicesused by a user of a bed. Example computing devices 414 include, but arenot limited to, mobile computing devices (e.g., mobile phones, tabletcomputers, laptops) and desktop computers.

The computing device 414 includes a power supply 1100, a processor 1102,and computer readable memory 1104. User input and output can betransmitted by, for example, speakers 1106, a touchscreen 1108, or othernot shown components such as a pointing device or keyboard. Thecomputing device 414 can run one or more applications 1110. Theseapplications can include, for example, application to allow the user tointeract with the system 400. These applications can allow a user toview information about the bed (e.g., sensor readings, sleep metrics),or configure the behavior of the system 400 (e.g., set a desiredfirmness to the bed, set desired behavior for peripheral devices). Insome cases, the computing device 414 can be used in addition to, or toreplace, the remote control 122 described previously.

FIG. 12 is a block diagram of an example bed data cloud service 410 athat can be used in a data processing system that can be associated witha bed system, including those described above with respect to FIGS. 1-3.In this example, the bed data cloud service 410 a is configured tocollect sensor data and sleep data from a particular bed, and to matchthe sensor and sleep data with one or more users that use the bed whenthe sensor and sleep data was generated.

The bed data cloud service 410 a is shown with a network interface 1200,a communication manager 1202, server hardware 1204, and server systemsoftware 1206. In addition, the bed data cloud service 410 a is shownwith a user identification module 1208, a device management 1210 module,a sensor data module 1212, and an advanced sleep data module 1214.

The network interface 1200 generally includes hardware and low levelsoftware used to allow one or more hardware devices to communicate overnetworks. For example the network interface 1200 can include networkcards, routers, modems, and other hardware needed to allow thecomponents of the bed data cloud service 410 a to communicate with eachother and other destinations over, for example, the Internet 412. Thecommunication manger 1202 generally comprises hardware and software thatoperate above the network interface 1200. This includes software toinitiate, maintain, and tear down network communications used by the beddata cloud service 410 a. This includes, for example, TCP/IP, SSL orTLS, Torrent, and other communication sessions over local or wide areanetworks. The communication manger 1202 can also provide load balancingand other services to other elements of the bed data cloud service 410a.

The server hardware 1204 generally includes the physical processingdevices used to instantiate and maintain bed data cloud service 410 a.This hardware includes, but is not limited to processors (e.g., centralprocessing units, ASICs, graphical processers), and computer readablememory (e.g., random access memory, stable hard disks, tape backup). Oneor more servers can be configured into clusters, multi-computer, ordatacenters that can be geographically separate or connected.

The server system software 1206 generally includes software that runs onthe server hardware 1204 to provide operating environments toapplications and services. The server system software 1206 can includeoperating systems running on real servers, virtual machines instantiatedon real servers to create many virtual servers, server level operationssuch as data migration, redundancy, and backup.

The user identification 1208 can include, or reference, data related tousers of beds with associated data processing systems. For example, theusers can include customers, owners, or other users registered with thebed data cloud service 410 a or another service. Each user can have, forexample, a unique identifier, user credentials, contact information,billing information, demographic information, or any othertechnologically appropriate information.

The device manager 1210 can include, or reference, data related to bedsor other products associated with data processing systems. For example,the beds can include products sold or registered with a systemassociated with the bed data cloud service 410 a. Each bed can have, forexample, a unique identifier, model and/or serial number, salesinformation, geographic information, delivery information, a listing ofassociated sensors and control peripherals, etc. Additionally, an indexor indexes stored by the bed data cloud service 410 a can identify usersthat are associated with beds. For example, this index can record salesof a bed to a user, users that sleep in a bed, etc.

The sensor data 1212 can record raw or condensed sensor data recorded bybeds with associated data processing systems. For example, a bed's dataprocessing system can have a temperature sensor, pressure sensor, andlight sensor. Readings from these sensors, either in raw form or in aformat generated from the raw data (e.g. sleep metrics) of the sensors,can be communicated by the bed's data processing system to the bed datacloud service 410 a for storage in the sensor data 1212. Additionally,an index or indexes stored by the bed data cloud service 410 a canidentify users and/or beds that are associated with the sensor data1212.

The bed data cloud service 410 a can use any of its available data togenerate advanced sleep data 1214. In general, the advanced sleep data1214 includes sleep metrics and other data generated from sensorreadings. Some of these calculations can be performed in the bed datacloud service 410 a instead of locally on the bed's data processingsystem, for example, because the calculations are computationallycomplex or require a large amount of memory space or processor powerthat is not available on the bed's data processing system. This can helpallow a bed system to operate with a relatively simple controller andstill be part of a system that performs relatively complex tasks andcomputations.

FIG. 13 is a block diagram of an example sleep data cloud service 410 bthat can be used in a data processing system that can be associated witha bed system, including those described above with respect to FIGS. 1-3.In this example, the sleep data cloud service 410 b is configured torecord data related to users' sleep experience.

The sleep data cloud service 410 b is shown with a network interface1300, a communication manager 1302, server hardware 1304, and serversystem software 1306. In addition, the sleep data cloud service 410 b isshown with a user identification module 1308, a pressure sensor manager1310, a pressure based sleep data module 1312, a raw pressure sensordata module 1314, and a non-pressure sleep data module 1316.

The pressure sensor manager 1310 can include, or reference, data relatedto the configuration and operation of pressure sensors in beds. Forexample, this data can include an identifier of the types of sensors ina particular bed, their settings and calibration data, etc.

The pressure based sleep data 1312 can use raw pressure sensor data 1314to calculate sleep metrics specifically tied to pressure sensor data.For example, user presence, movements, weight change, heart rate, andbreathing rate can all be determined from raw pressure sensor data 1314.Additionally, an index or indexes stored by the sleep data cloud service410 b can identify users that are associated with pressure sensors, rawpressure sensor data, and/or pressure based sleep data.

The non-pressure sleep data 1316 can use other sources of data tocalculate sleep metrics. For example, user entered preferences, lightsensor readings, and sound sensor readings can all be used to tracksleep data. Additionally, an index or indexes stored by the sleep datacloud service 410 b can identify users that are associated with othersensors and/or non-pressure sleep data 1316.

FIG. 14 is a block diagram of an example user account cloud service 410c that can be used in a data processing system that can be associatedwith a bed system, including those described above with respect to FIGS.1-3. In this example, the user account cloud service 410 c is configuredto record a list of users and to identify other data related to thoseusers.

The user account cloud service 410 c is shown with a network interface1400, a communication manager 1402, server hardware 1404, and serversystem software 1406. In addition, the user account cloud service 410 cis shown with a user identification module 1408, a purchase historymodule 1410, an engagement module 1412, and an application usage historymodule 1414.

The user identification module 1408 can include, or reference, datarelated to users of beds with associated data processing systems. Forexample, the users can include customers, owners, or other usersregistered with the user account cloud service 410 a or another service.Each user can have, for example, a unique identifier, and usercredentials, demographic information, or any other technologicallyappropriate information.

The purchase history module 1410 can include, or reference, data relatedto purchases by users. For example, the purchase data can include asale's contact information, billing information, and salespersoninformation. Additionally, an index or indexes stored by the useraccount cloud service 410 c can identify users that are associated witha purchase.

The engagement 1412 can track user interactions with the manufacturer,vendor, and/or manager of the bed and or cloud services. This engagementdata can include communications (e.g., emails, service calls), data fromsales (e.g., sales receipts, configuration logs), and social networkinteractions.

The usage history module 1414 can contain data about user interactionswith one or more applications and/or remote controls of a bed. Forexample, a monitoring and configuration application can be distributedto run on, for example, computing devices 412. This application can logand report user interactions for storage in the application usagehistory module 1414. Additionally, an index or indexes stored by theuser account cloud service 410 c can identify users that are associatedwith each log entry.

FIG. 15 is a block diagram of an example point of sale cloud service1500 that can be used in a data processing system that can be associatedwith a bed system, including those described above with respect to FIGS.1-3. In this example, the point of sale cloud service 1500 is configuredto record data related to users' purchases.

The point of sale cloud service 1500 is shown with a network interface1502, a communication manager 1504, server hardware 1506, and serversystem software 1508. In addition, the point of sale cloud service 1500is shown with a user identification module 1510, a purchase historymodule 1512, and a setup module 1514.

The purchase history module 1512 can include, or reference, data relatedto purchases made by users identified in the user identification module1510. The purchase information can include, for example, data of a sale,price, and location of sale, delivery address, and configuration optionsselected by the users at the time of sale. These configuration optionscan include selections made by the user about how they wish their newlypurchased beds to be setup and can include, for example, expected sleepschedule, a listing of peripheral sensors and controllers that they haveor will install, etc.

The bed setup module 1514 can include, or reference, data related toinstallations of beds that users' purchase. The bed setup data caninclude, for example, the date and address to which a bed is delivered,the person that accepts delivery, the configuration that is applied tothe bed upon delivery, the name or names of the person or people whowill sleep on the bed, which side of the bed each person will use, etc.

Data recorded in the point of sale cloud service 1500 can be referencedby a user's bed system at later dates to control functionality of thebed system and/or to send control signals to peripheral componentsaccording to data recorded in the point of sale cloud service 1500. Thiscan allow a salesperson to collect information from the user at thepoint of sale that later facilitates automation of the bed system. Insome examples, some or all aspects of the bed system can be automatedwith little or no user-entered data required after the point of sale. Inother examples, data recorded in the point of sale cloud service 1500can be used in connection with a variety of additional data gatheredfrom user-entered data.

FIG. 16 is a block diagram of an example environment cloud service 1600that can be used in a data processing system that can be associated witha bed system, including those described above with respect to FIGS. 1-3.In this example, the environment cloud service 1600 is configured torecord data related to users' home environment.

The environment cloud service 1600 is shown with a network interface1602, a communication manager 1604, server hardware 1606, and serversystem software 1608. In addition, the environment cloud service 1600 isshown with a user identification module 1610, an environmental sensormodule 1612, and an environmental factors module 1614.

The environmental sensors module 1612 can include a listing of sensorsthat users' in the user identification module 1610 have installed intheir bed. These sensors include any sensors that can detectenvironmental variables—light sensors, noise sensors, vibration sensors,thermostats, etc. Additionally, the environmental sensors module 1612can store historical readings or reports from those sensors.

The environmental factors module 1614 can include reports generatedbased on data in the environmental sensors module 1612. For example, fora user with a light sensor with data in the environment sensors module1612, the environmental factors module 1614 can hold a report indicatingthe frequency and duration of instances of increased lighting when theuser is asleep.

In the examples discussed here, each cloud service 410 is shown withsome of the same components. In various configurations, these samecomponents can be partially or wholly shared between services, or theycan be separate. In some configurations, each service can have separatecopies of some or all of the components that are the same or differentin some ways. Additionally, these components are only supplied asillustrative examples. In other examples each cloud service can havedifferent number, types, and styles of components that are technicallypossible.

FIG. 17 is a block diagram of an example of using a data processingsystem that can be associated with a bed (such as a bed of the bedsystems described herein) to automate peripherals around the bed. Shownhere is a behavior analysis module 1700 that runs on the pumpmotherboard 402. For example, the behavior analysis module 1700 can beone or more software components stored on the computer memory 512 andexecuted by the processor 502. In general, the behavior analysis module1700 can collect data from a wide variety of sources (e.g., sensors,non-sensor local sources, cloud data services) and use a behavioralalgorithm 1702 to generate one or more actions to be taken (e.g.,commands to send to peripheral controllers, data to send to cloudservices). This can be useful, for example, in tracking user behaviorand automating devices in communication with the user's bed.

The behavior analysis module 1700 can collect data from anytechnologically appropriate source, for example, to gather data aboutfeatures of a bed, the bed's environment, and/or the bed's users. Somesuch sources include any of the sensors of the sensor array 406. Forexample, this data can provide the behavior analysis module 1700 withinformation about the current state of the environment around the bed.For example, the behavior analysis module 1700 can access readings fromthe pressure sensor 902 to determine the pressure of an air chamber inthe bed. From this reading, and potentially other data, user presence inthe bed can be determined. In another example, the behavior analysismodule can access a light sensor 908 to detect the amount of light inthe bed's environment.

Similarly, the behavior analysis module 1700 can access data from cloudservices. For example, the behavior analysis module 1700 can access thebed cloud service 410 a to access historical sensor data 1212 and/oradvanced sleep data 1214. Other cloud services 410, including those notpreviously described can be accessed by the behavior analysis module1700. For example, the behavior analysis module 1700 can access aweather reporting service, a 3^(rd) party data provider (e.g., trafficand news data, emergency broadcast data, user travel data), and/or aclock and calendar service.

Similarly, the behavior analysis module 1700 can access data fromnon-sensor sources 1704. For example, the behavior analysis module 1700can access a local clock and calendar service (e.g., a component of themotherboard 402 or of the processor 502).

The behavior analysis module 1700 can aggregate and prepare this datafor use by one or more behavioral algorithms 1702. The behavioralalgorithms 1702 can be used to learn a user's behavior and/or to performsome action based on the state of the accessed data and/or the predicteduser behavior. For example, the behavior algorithm 1702 can useavailable data (e.g., pressure sensor, non-sensor data, clock andcalendar data) to create a model of when a user goes to bed every night.Later, the same or a different behavioral algorithm 1702 can be used todetermine if an increase in air chamber pressure is likely to indicate auser going to bed and, if so, send some data to a third-party cloudservice 410 and/or engage a device such as a pump controller 504,foundation actuators 1706, temperature controller 1008, under-bedlighting 1010, a peripheral controller 1002, or a peripheral controller1004, to name a few.

In the example shown, the behavioral analysis module 1700 and thebehavioral algorithm 1702 are shown as components of the motherboard402. However, other configurations are possible. For example, the sameor a similar behavioral analysis module and/or behavior algorithm can berun in one or more cloud services, and the resulting output can be sentto the motherboard 402, a controller in the controller array 408, or toany other technologically appropriate recipient.

FIG. 18 shows an example of a computing device 1800 and an example of amobile computing device that can be used to implement the techniquesdescribed here. The computing device 1800 is intended to representvarious forms of digital computers, such as laptops, desktops,workstations, personal digital assistants, servers, blade servers,mainframes, and other appropriate computers. The mobile computing deviceis intended to represent various forms of mobile devices, such aspersonal digital assistants, cellular telephones, smart-phones, andother similar computing devices. The components shown here, theirconnections and relationships, and their functions, are meant to beexemplary only, and are not meant to limit implementations of theinventions described and/or claimed in this document.

The computing device 1800 includes a processor 1802, a memory 1804, astorage device 1806, a high-speed interface 1808 connecting to thememory 1804 and multiple high-speed expansion ports 1810, and alow-speed interface 1812 connecting to a low-speed expansion port 1814and the storage device 1806. Each of the processor 1802, the memory1804, the storage device 1806, the high-speed interface 1808, thehigh-speed expansion ports 1810, and the low-speed interface 1812, areinterconnected using various busses, and can be mounted on a commonmotherboard or in other manners as appropriate. The processor 1802 canprocess instructions for execution within the computing device 1800,including instructions stored in the memory 1804 or on the storagedevice 1806 to display graphical information for a GUI on an externalinput/output device, such as a display 1816 coupled to the high-speedinterface 1808. In other implementations, multiple processors and/ormultiple buses can be used, as appropriate, along with multiple memoriesand types of memory. Also, multiple computing devices can be connected,with each device providing portions of the necessary operations (e.g.,as a server bank, a group of blade servers, or a multi-processorsystem).

The memory 1804 stores information within the computing device 1800. Insome implementations, the memory 1804 is a volatile memory unit orunits. In some implementations, the memory 1804 is a non-volatile memoryunit or units. The memory 1804 can also be another form ofcomputer-readable medium, such as a magnetic or optical disk.

The storage device 1806 is capable of providing mass storage for thecomputing device 1800. In some implementations, the storage device 1806can be or contain a computer-readable medium, such as a floppy diskdevice, a hard disk device, an optical disk device, or a tape device, aflash memory or other similar solid state memory device, or an array ofdevices, including devices in a storage area network or otherconfigurations. A computer program product can be tangibly embodied inan information carrier. The computer program product can also containinstructions that, when executed, perform one or more methods, such asthose described above. The computer program product can also be tangiblyembodied in a computer- or machine-readable medium, such as the memory1804, the storage device 1806, or memory on the processor 1802.

The high-speed interface 1808 manages bandwidth-intensive operations forthe computing device 1800, while the low-speed interface 1812 manageslower bandwidth-intensive operations. Such allocation of functions isexemplary only. In some implementations, the high-speed interface 1808is coupled to the memory 1804, the display 1816 (e.g., through agraphics processor or accelerator), and to the high-speed expansionports 1810, which can accept various expansion cards (not shown). In theimplementation, the low-speed interface 1812 is coupled to the storagedevice 1806 and the low-speed expansion port 1814. The low-speedexpansion port 1814, which can include various communication ports(e.g., USB, Bluetooth, Ethernet, wireless Ethernet) can be coupled toone or more input/output devices, such as a keyboard, a pointing device,a scanner, or a networking device such as a switch or router, e.g.,through a network adapter.

The computing device 1800 can be implemented in a number of differentforms, as shown in the figure. For example, it can be implemented as astandard server 1820, or multiple times in a group of such servers. Inaddition, it can be implemented in a personal computer such as a laptopcomputer 1822. It can also be implemented as part of a rack serversystem 1824. Alternatively, components from the computing device 1800can be combined with other components in a mobile device (not shown),such as a mobile computing device 1850. Each of such devices can containone or more of the computing device 1800 and the mobile computing device1850, and an entire system can be made up of multiple computing devicescommunicating with each other.

The mobile computing device 1850 includes a processor 1852, a memory1864, an input/output device such as a display 1854, a communicationinterface 1866, and a transceiver 1868, among other components. Themobile computing device 1850 can also be provided with a storage device,such as a micro-drive or other device, to provide additional storage.Each of the processor 1852, the memory 1864, the display 1854, thecommunication interface 1866, and the transceiver 1868, areinterconnected using various buses, and several of the components can bemounted on a common motherboard or in other manners as appropriate.

The processor 1852 can execute instructions within the mobile computingdevice 1850, including instructions stored in the memory 1864. Theprocessor 1852 can be implemented as a chipset of chips that includeseparate and multiple analog and digital processors. The processor 1852can provide, for example, for coordination of the other components ofthe mobile computing device 1850, such as control of user interfaces,applications run by the mobile computing device 1850, and wirelesscommunication by the mobile computing device 1850.

The processor 1852 can communicate with a user through a controlinterface 1858 and a display interface 1856 coupled to the display 1854.The display 1854 can be, for example, a TFT (Thin-Film-Transistor LiquidCrystal Display) display or an OLED (Organic Light Emitting Diode)display, or other appropriate display technology. The display interface1856 can comprise appropriate circuitry for driving the display 1854 topresent graphical and other information to a user. The control interface1858 can receive commands from a user and convert them for submission tothe processor 1852. In addition, an external interface 1862 can providecommunication with the processor 1852, so as to enable near areacommunication of the mobile computing device 1850 with other devices.The external interface 1862 can provide, for example, for wiredcommunication in some implementations, or for wireless communication inother implementations, and multiple interfaces can also be used.

The memory 1864 stores information within the mobile computing device1850. The memory 1864 can be implemented as one or more of acomputer-readable medium or media, a volatile memory unit or units, or anon-volatile memory unit or units. An expansion memory 1874 can also beprovided and connected to the mobile computing device 1850 through anexpansion interface 1872, which can include, for example, a SIMM (SingleIn Line Memory Module) card interface. The expansion memory 1874 canprovide extra storage space for the mobile computing device 1850, or canalso store applications or other information for the mobile computingdevice 1850. Specifically, the expansion memory 1874 can includeinstructions to carry out or supplement the processes described above,and can include secure information also. Thus, for example, theexpansion memory 1874 can be provide as a security module for the mobilecomputing device 1850, and can be programmed with instructions thatpermit secure use of the mobile computing device 1850. In addition,secure applications can be provided via the SIMM cards, along withadditional information, such as placing identifying information on theSIMM card in a non-hackable manner.

The memory can include, for example, flash memory and/or NVRAM memory(non-volatile random access memory), as discussed below. In someimplementations, a computer program product is tangibly embodied in aninformation carrier. The computer program product contains instructionsthat, when executed, perform one or more methods, such as thosedescribed above. The computer program product can be a computer- ormachine-readable medium, such as the memory 1864, the expansion memory1874, or memory on the processor 1852. In some implementations, thecomputer program product can be received in a propagated signal, forexample, over the transceiver 1868 or the external interface 1862.

The mobile computing device 1850 can communicate wirelessly through thecommunication interface 1866, which can include digital signalprocessing circuitry where necessary. The communication interface 1866can provide for communications under various modes or protocols, such asGSM voice calls (Global System for Mobile communications), SMS (ShortMessage Service), EMS (Enhanced Messaging Service), or MMS messaging(Multimedia Messaging Service), CDMA (code division multiple access),TDMA (time division multiple access), PDC (Personal Digital Cellular),WCDMA (Wideband Code Division Multiple Access), CDMA2000, or GPRS(General Packet Radio Service), among others. Such communication canoccur, for example, through the transceiver 1868 using aradio-frequency. In addition, short-range communication can occur, suchas using a Bluetooth, WiFi, or other such transceiver (not shown). Inaddition, a GPS (Global Positioning System) receiver module 1870 canprovide additional navigation- and location-related wireless data to themobile computing device 1850, which can be used as appropriate byapplications running on the mobile computing device 1850.

The mobile computing device 1850 can also communicate audibly using anaudio codec 1860, which can receive spoken information from a user andconvert it to usable digital information. The audio codec 1860 canlikewise generate audible sound for a user, such as through a speaker,e.g., in a handset of the mobile computing device 1850. Such sound caninclude sound from voice telephone calls, can include recorded sound(e.g., voice messages, music files, etc.) and can also include soundgenerated by applications operating on the mobile computing device 1850.

The mobile computing device 1850 can be implemented in a number ofdifferent forms, as shown in the figure. For example, it can beimplemented as a cellular telephone 1880. It can also be implemented aspart of a smart-phone 1882, personal digital assistant, or other similarmobile device.

Various implementations of the systems and techniques described here canbe realized in digital electronic circuitry, integrated circuitry,specially designed ASICs (application specific integrated circuits),computer hardware, firmware, software, and/or combinations thereof.These various implementations can include implementation in one or morecomputer programs that are executable and/or interpretable on aprogrammable system including at least one programmable processor, whichcan be special or general purpose, coupled to receive data andinstructions from, and to transmit data and instructions to, a storagesystem, at least one input device, and at least one output device.

These computer programs (also known as programs, software, softwareapplications or code) include machine instructions for a programmableprocessor, and can be implemented in a high-level procedural and/orobject-oriented programming language, and/or in assembly/machinelanguage. As used herein, the terms machine-readable medium andcomputer-readable medium refer to any computer program product,apparatus and/or device (e.g., magnetic discs, optical disks, memory,Programmable Logic Devices (PLDs)) used to provide machine instructionsand/or data to a programmable processor, including a machine-readablemedium that receives machine instructions as a machine-readable signal.The term machine-readable signal refers to any signal used to providemachine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniquesdescribed here can be implemented on a computer having a display device(e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor)for displaying information to the user and a keyboard and a pointingdevice (e.g., a mouse or a trackball) by which the user can provideinput to the computer. Other kinds of devices can be used to provide forinteraction with a user as well; for example, feedback provided to theuser can be any form of sensory feedback (e.g., visual feedback,auditory feedback, or tactile feedback); and input from the user can bereceived in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in acomputing system that includes a backend component (e.g., as a dataserver), or that includes a middleware component (e.g., an applicationserver), or that includes a frontend component (e.g., a client computerhaving a graphical user interface or a Web browser through which a usercan interact with an implementation of the systems and techniquesdescribed here), or any combination of such backend, middleware, orfrontend components. The components of the system can be interconnectedby any form or medium of digital data communication (e.g., acommunication network). Examples of communication networks include alocal area network (LAN), a wide area network (WAN), and the Internet.

The computing system can include clients and servers. A client andserver are generally remote from each other and typically interactthrough a communication network. The relationship of client and serverarises by virtue of computer programs running on the respectivecomputers and having a client-server relationship to each other.

FIG. 19 is a block diagram of an example of a system 1900 for fusingacoustic data with pressure data in order to determine snore andbreathing parameters for a user on a bed. In the system 1900, snore andbreathing is monitored using a combination of pressure and acousticsensing modalities. That is, a user laying on a bed 1902 can bemonitored in a way that accounts for acoustic phenomena (e.g., sound)generated by the user's breathing and/or snoring, and at the same time,the same user laying the bed 1902 can also be monitored in a differentway that accounts for pressure phenomena (e.g., changing torso shape onthe bed 1902) generated by the user's breathing and/or snoring. As isshown, this can be accomplished with no more effort than the user simplylaying on the bed 1902. Unlike, for example, in a clinicalpolysomnography lab, the user does not need to wear on-body sensors ortravel out of their home to a special location where medical equipmentis available. Instead, the user simply lays in bed every night and havetheir breathing and snoring monitored. This is advantageous for at leasttwo reasons. First, the user can be monitored every night. Clinicalpolysomnography is very expensive, and most users are only able to haveone night's sleep data tracked. A second advantage of this technology isthat the user is able to sleep in their normal environment. This is theenvironment that is likely to be most comfortable and familiar to theuser, whereas a polysomnography presents a strange and potentiallydisconcerting environment that has the possibility of influencing theuser's sleep that is being measured.

Acoustic sensing can be accomplished using a physical acoustic sensor1904 that converts acoustic waves to electrical signals. Exampleacoustic sensors 1904 include, but are not limited to, sound sensor suchas microphone embedded in the bed 1902, a cellular phone, a homeautomation hub/access point, etc.

A signal conditioner 1906 modifies the raw sensor signal to change theraw sensor data in a way that makes the raw sensor data more useful tothe system 1900. For example, the signal conditioner 1906 can amplifythe acoustics in the frequency band of interest through the use ofamplifiers and filters.

A digitizer 1908 can convert the conditioned analog acoustic signals toa stream of digital acoustic signals. For example, the digitizer 1908 isable to convert the analog acoustic signal into a digital representation(such as numbers) so that it can be stored or processed by digital logiccircuitry. For example, the digitizer can receive the analog acousticstream 2004 having a wave with the particular shape, and generate astream of digital values that describe that wave according to apredetermined conversion algorithm. This digital stream, in someimplementations, is a two's-compliment binary number proportional to theinput wave's value at a particular sample rate.

Snore and breathing are further monitored by a pressure sensing unit inwhich a pressure sensor senses instantaneous air pressure in at leastone air-filled chamber of the bed 1902 and converts that pressurereading into an electrical signal.

A signal conditioner 1912 modifies the raw sensor signal to change theraw sensor data in a way that makes the raw sensor data more useful tothe system 1900. For example, the signal conditioner 1906 can amplifythe pressure signal in the frequency band of interest through the use ofamplifiers and filters.

A digitizer 1914 can convert the conditioned analog pressure signals toa stream digital pressure signals. For example, the digitizer 1908 isable to convert the analog pressure signal into a digital representation(such as numbers) so that it can be stored or processed by digital logiccircuitry. For example, the digitizer 1914 can convert a smoothelectrical pressure wave into a series of high and low voltages thatencode the values of 1 and 0 to create the digital representation.

A processor unit receives and buffers the incoming sound and pressuredata streams simultaneously and provides buffered data epochs to asnore/breathing analysis algorithm 1916 that runs on the processor andthat is capable of generating snore/breathing parameters for the user onthe bed. For example, a snore/breathing analysis engine 1916 may run onthe processor unit (either local to the bed or remote), and maydetermine snore/breathing parameters 1918 for the user on the bed. Thesnore/breathing parameters 1918 can include parameters representative ofstatus and severity of snoring, snore presence (e.g., a Boolean value 1or 0), snore intensity for example in terms of Sound Pressure Level(SPL) (e.g., 60 dB), snore severity level for example as used inclinical grading (e.g., between mild to loud), apnea presence (e.g., 0or 1) and severity scale (e.g., a number between 0 to 5), etc. Theseparameters may be in any appropriate digital circuitry representationincluding standard data formats such as integer, floating point, and canbe saved in a variety of different formats such as the eXtensivle MarkupLanguage (XML). In this example, the snore/breathing analysis engine1916 is generating one set of snore/breathing parameters 1918 for eachreceived epoch of acoustic and pressure signals.

In another system, a bed is created to hold two users. Examples of thesekinds of beds are often marketed under the size name “Queen,” “King,”etc. In such a case, the same number of acoustic sensors 1904 andpressure sensors 1910 may be used, or a greater or lesser number may beused. For example, one pressure sensor may alternate readings betweeneach user's side of the bed. In another example, one pressure sensor maybe dedicated to reading one side of the bed while another pressuresensor may be dedicated to the other side of the bed.

Fusing of acoustic and pressure signals can be used to advantageouslyproduce more accurate snore/breathing parameters 1918 than would bepossible with only acoustic signals or only pressure signals. Forexample, there may be many cases where noise would be present in onesignal and not the other. One example is the often unavoidableimperfections of a given sensor. Both the acoustic and pressure sensorsare physical objects, and any physical sensor produces some unavoidablenoise in their sensing. However, if the noise profiles of the differentsensors are not identical, the differential noises can be used to cancelor reduce the influence of the noise. Further, some real phenomena otherthan user breathing/snoring may be captured by some but not the othertypes of sensors. A pet walking across the bed may produce pressurewaves that could be coincidently similar to breathing pressure waves.However, as the pet would not produce acoustic energy similar tobreathing to be picked up by the acoustic sensors, this noise in thesystem can be reduced or eliminated.

FIG. 20 is drawing of example of 60 seconds of sensor readings collectedfrom acoustic and pressure sensors while a subject is in bed sleepingand snoring The top panel shows the subjects digital pressure data whichshows his respiratory pattern as the bed's user is inhaling and exhalingduring sleep. The mid panel shows the high pass filtered pressure data(20 Hz and above) which indicates the subjects snoring pattern. Fromthis data one can estimate the snoring rate. The bottom panel shows theaudio data with ambient noise filtered. This data also shows user'ssnoring pattern and can be used to estimate the user's snoring rate,snoring scale, etc. This data shows the complementary and correlatedsnore/breathing information present in two different modalities. Suchinformation can be used to improve the accuracy of snore detection orsnore parameter estimation.

FIG. 21 is a swimlane diagram of an example process 2100 for determiningsnore and breath parameters and for driving a controllable device. Inthe process 2100, a user is sleeping on a bed, breathing and possiblysnoring while they sleep. Sensors in the user's environment recordacoustic (e.g., sound) and pressure (e.g., user pressure against thebed) phenomena, and a controller of the bed determines snore/breathparameters. In response to determining the breath/snore parameters, thecontroller drives a controllable device to affect the user'senvironment.

An acoustic sensor senses acoustics in the environment of the user(2112). For example, a microphone embedded in the side of a user'smattress can detect audible noise and/or acoustic energy generated bythe user outside of the audible spectrum. The microphone can generate ananalog electrical wave that represents the sensed acoustics, pass theanalog electrical wave to a signal conditioner that filters energyoutside of a band of interest and that amplifies energy within anotherband of interest such that the signal-to-noise ratio of the analog waveis enhanced. The enhanced analog wave may be then sent to a digitizerthat converts the analog wave into an electrical signal that carries 1'sand 0's that represent the analog signal.

A pressure sensor senses pressure in the environment of the user (2114).For example, a pressure transducer within the user's bed can include adiagraph that bulges and relaxes as the pressure within an air-bladderof the bed under the user experiences changes in pressure from theuser's breathing and snoring action. This change in shape of thediaphragm can cause an electrical component to change properties andinfluence a smooth electrical signal to generate an analog electricalsignal representative of the instant pressure of the air-bladder. Thetransducer can pass the analog electrical wave to a signal conditionerthat filters energy outside of a band of interest and that amplifiesenergy within another band of interest such that the signal:noise ratioof the analog wave is enhanced. The enhanced analog wave may be thensent to a digitizer that converts the analog wave into a digitalrepresentation.

A controller receives a stream of acoustic data (2116) and receives astream of pressure data (2118). For example, the pressure sensor and theacoustic sensor 2202 may be connected to the processor 2206 by a wirebus, by a wireless data link in a data network, etc. The processor 2206can receive the acoustic stream and the pressure stream as they areserved, including simultaneously and constantly.

The controller combines the acoustic stream and the pressure stream inorder to generate a set of snore/breath parameters (2126). For example,the processor 2206 can execute a snore/breathing analysis engine thatconcurrently or sequentially runs one or more fusion algorithms thateach use pressure and acoustic readings in order to generate data. Thesnore/breathing analysis engine may be responsible for, for example,spinning up execution threads to execute the various fusion algorithms,collecting votes from each of the fusion algorithms (2122), allocatingand deallocating memory or other resources to the various fusionalgorithms, etc. Example fusion algorithms are described with moredetail later.

In some cases, a single fusion algorithm may be used. In such a case,the algorithm can be configured to generate a single set of snore/breathparameters, and those snore/breath parameters may be used. In somecases, more than one fusion algorithm may be used. In such a case, thecontroller 2206 can aggregate or select a single snore/breath parameterset to be used.

In some cases, the snore/breathing analysis engine may only be usedconditionally. For example, the processor 2206 may first determine thepresence state of the bed. If the bed is determined to be empty, theprocessor 2206 may opt not to continue with the process 2100. In somecases, the processor 2206 may first determine a sleep state of the userin the bed. If the bed determines that the user is awake, the processor2206 may opt not to continue with the process 2100. These options may beuseful, for example, to avoid recording information or processinginformation when the user is not in bed or asleep, thus reducing usedresources and preserving privacy.

The controller reports the snore/breath parameters and a cloud reportinginterface 2208 receives the snore/breath parameters (2128). For example,with the snore/breathing parameters for a particular epoch determined,the processor 2206 can send the snore/breathing parameters to a cloudreporting interface for use by the user in one or more cloud-basedapplications. In some instances, the processor 2206 can marshal acollection of snore/breathing parameters together for a singletransmission (e.g., all snore/breathing parameters within the last houror day).

The controller selects a device action (2130). For example, the user mayset one or more home-automation rules that should be triggered upondetection of a particular sleep pattern or snore pattern. In oneexample, a user may have a rule created that engages a heater andhumidifier if a particular set of snore/breathing parameters indicatethe user, an allergy-sufferer, is undergoing slightly labored breathing.In another example, the user may have a rule set to elevate the headportion of the bed if snoring is detected, in order to attempt to reduceor eliminate the snoring. In response to a rule meeting a condition toexecute, the controller can send an instruction to a controllable device2210. The controllable device receives instruction to drive thecontrollable device (2132). For example, the HVAC can receive theinstructions to increase temperature and humidity, or the foundation ofthe bed may receive instructions to elevate the head of the bed.

FIG. 22 is a swimlane diagram of an example process 2200 for determiningsnore and breath parameters and for driving a controllable device.Unlike in the process 2100, in the process 2200 a cloud analytics system2202 is used. Here, the acoustic sensor 2102 and the pressure sensor2104 report the acoustic and pressure data to the cloud reportinginterface 2108 for use by the cloud analytic system 2202.

FIG. 23 is a flowchart diagram of an example process 2300 for fusingstreams of pressure and acoustic data. The process 2300 may be used, forexample, as one of the fusion algorithms by the processor 2206 and/orcloud analytics system 2202 to generate a snore/sleep parameter for auser on a bed.

Respiratory parameters are determined based on instantaneous pressuresignals (2302). For example, at regular intervals within an epoch of apressure signal (e.g., every half second, every 0.1 seconds), theprocess 2300 can identify a collection of respiratory parameters thatmost closely match the pressure signal those points in time.

Respiratory parameters are determined based on instantaneous acousticsignals (2304). For example, at the same regular interval within thesame epoch of the acoustic signal, the process 2300 can identify acollection of respiratory parameters that most closely match theacoustic signal at those points in time.

Areas of the epoch in which pressure and acoustic both indicate similarbreathing action are identified (2306). For example, the process 2300can iterate over every time interval within the epoch and compare thecollection of respiratory parameters from the pressure signal with thecollection of respiratory parameters from the acoustic signal. Any pairof respiratory parameters that match (e.g., are identical, are within athreshold similarity) may be preserved while pairs of parameters that donot match may be discarded.

A new candidate snore/sleep parameter may be generated from the matchingareas of each epoch (2308). In order to put forward a candidatesnore/sleep parameter as a vote, the process 2300 can aggregate thepreserved pairs of parameters into a single candidate set of snore/sleepparameters. For example, average, median, or modal values may becalculated, a random selection may be made, etc.

FIG. 24 is a flowchart diagram of an example process 2400 for fusingstreams of pressure and acoustic data. The process 2400 may be used, forexample, as one of the fusion algorithms by the processor 2206 and/orcloud analytics system 2202 to generate a snore/sleep parameter for auser on a bed.

Features of potential snores/breaths are identified from acoustics(2402). For example, the process 2400 can examine the acoustics toidentify patterns in the acoustics to identify features in the acousticstream indicative of breathing and snoring. These features can include,but are not limited to, mathematical properties of a waveform,properties of the waveform in a transform domain such as FourierTransform. For example, a particular periodicity, amplitude, sub-bandenergy, centeroid frequency, etc. may be identified as features. Thesefeatures may also include, but are not limited to, extracted breathingfeatures such as breath's per minute, breathing amplitude, etc. Whenthese features are found, time the identified features may be preservedfor the epoch in which the examination was made. By doing so, theprocess 2400 can create a collection of features identified based on thereceived acoustics.

Features of potential snores/breaths are identified from pressure(2404). For example, the process 2400 can examine the pressure signal toidentify patterns in the pressure signal that match known-good samplesof different types of breathing and snoring. When those matches aremade, time and identified features may be preserved for the epoch inwhich the examination was made. By doing so, the process 2400 can createa collection of features identified based on the received pressuresignals.

Agreement between features from the acoustics and the pressure signalsis identified (2406). For example, the process 2400 can identifyfeatures that are found in both the analysis of the acoustic signal andthe analysis of the pressure signal. Those features found in bothanalyses may be preserved by the process 2400, and the process 2400 candiscard those features not found in both analyses.

Candidate snore/sleep parameters are generated from feature agreements(2408). For example, the process 2400 can aggregate the agreeingfeatures into a single candidate set of snore/sleep parameters. Forexample, average, median, or modal values may be calculated, a randomselection may be made, etc.

FIG. 25 is a flowchart diagram of an example process for fusing 2500streams of pressure and acoustic data. The process 2500 may be used, forexample, as one of the fusion algorithms by the processor 2206 and/orcloud analytics system 2202 to generate a snore/sleep parameter for auser on a bed.

Bed presence state is identified (2502). For example, the process 2500may, as an initial matter, determine if there is a user in the bed atall. In cases in which no user is found to be in the bed, the process2500 may terminate. This may be beneficial, for example, because in manysituations acoustic or pressure readings for snore/breathing provide nopurpose when a user is not in the bed. Further, when a user is not inbed, any positive readings would be a false positive, and the earlytermination of a snore/breathing analysis could prevent inadvertent datalogging or automation actuation when none should take place.

Sleep state is identified (2504). For example, the process 2500 maydetermine, once it is known that a user is in the bed, if the user isawake, asleep, or optionally in a particular sleep stage. Depending onthe sleep state that is determined, the process 2500 may choose toterminate or to continue. For example, a user may configure their bedwith breathing-based home automation rules that only trigger when theuser is asleep. In such a case, terminating when the user is in bed butnot asleep prevents issues with false positives, overhead, etc.

Candidate snore/breathing parameters are generated consistent with theidentified presence and sleep state (2508). For example, the process2500 can generate a plurality of snore/breathing parameters and prunethose that are not consistent with being asleep. In some examples, theprocess 2500 can generate candidate snore/breathing parameters usingtechniques that only produce values that are possible when a user issleeping.

FIG. 26 is a flowchart diagram of an example process 2600 for fusingstreams of pressure and acoustic data. The process 2600 may be used, forexample, as one of the fusion algorithms by the processor 2206 and/orcloud analytics system 2202 to generate a snore/sleep parameter for auser on a bed.

Acoustic and pressure streams are applied to a plurality of fusionalgorithms (2602). For example, the process 2600 can include accessingand initiating two or more fusion algorithms. Each of these fusionalgorithms may be configures to fuse the acoustic and pressure streamsin different way in order to generate candidate snore/breathingparameters.

Votes are collected from the plurality of fusion algorithms (2604). Forexample, as each of the plurality of candidate snore/breathingparameters is generated by each of the fusion algorithm, the process2600 can store the candidate snore/breathing parameters in memory. Votesare tallied (2608). For example, once all fusion algorithms havecompleted, or once some (e.g., a threshold number) of fusion algorithmshave completed, the process 2600 can aggregate the results. For example,the process 2600 can count all candidate snore/breathing parameters thatare identical or within a threshold similarity as a vote for the sameresult.

A winning set of snore/breathing parameters are selected from thetallied votes (2610). For example, the process 2600 can identify thecandidate snore/breathing parameters with the highest vote total, selectthat candidate as the winning candidate, and discard the othercandidates.

Four example fusion algorithms have been described, but it will beappreciated that other fusion algorithms and combinations of fusionalgorithms may be used to generate vote pools.

For example, machine learning techniques may be used. In some examples,training data of acoustic and pressure readings is tagged for varioussnore/breathing parameters. Machine learning techniques are used totrain one or more classifiers based on the tagged training data, andthose classifiers may be used as fusion algorithms.

In another example, personalized vote aggregators may be used. Theseaggregators may be initially generic—that is, they may operate the samefor all users or a large collection of users. Then, the results of thevoting can be retrospectively analyzed in order to change the votingscheme to increase accuracy. Some voting analysis operates too slowly,due to complexity, to use to drive home automation. However, this slowanalysis may be used on historical vote results to identify accurate andinaccurate vote results. Using the accurate and inaccurate vote results,change to vote aggregation may be applied to increase prospective votes.

FIG. 27 is a flowchart diagram of an example process 2700 for fusingstreams of pressure and acoustic data. In the process 2700, a digitalacoustic stream is framed/buffered at 2702. The digital acoustic streamis then scaled and normalized within each of a plurality of epochs intime and transform domains 2704. The digital pressure stream isframed/buffered at 2702. The digital pressure stream is then scaled andnormalized within each of a plurality of epochs in time and transformdomains 2708. Acoustic and pressure data is fused 2710 to createsnore/breathing parameters 2712.

FIG. 28 is a flowchart diagram of an example process 2800 for fusingstreams of pressure and acoustic data. In the process 2800, a digitalacoustic stream is framed/buffered at 2802. The digital acoustic streamis then used to estimate parameters in time or transform domain 2804.The digital pressure stream is framed/buffered at 2806. The digitalpressure stream is then used to estimate parameters in time or transformdomain 2808. Acoustic and pressure data is fused 2810 to createsnore/breathing parameters 2812.

FIG. 29 is a flowchart diagram of an example process 2900 for fusingstreams of pressure and acoustic data. In the process 2900, a digitalacoustic stream is framed/buffered at 2902. The digital acoustic streamis then used to compute acoustic features in time or transform domain2904. The digital pressure stream is framed/buffered at 2906. Thedigital pressure stream is then used to compute pressure features intime or transform domain 2908. Acoustic and pressure features are thenapplied to machine learning classifiers in order to createsnore/breathing parameters 2912.

FIG. 30 is a flowchart diagram of an example process 3000 for fusingstreams of pressure and acoustic data using the deep learning framework.In the process 3000, a digital acoustic stream is framed/buffered at3002. The digital acoustic stream is then scaled and normalized withineach of a plurality of epochs in time and transform domains 3004.Similarly, the digital pressure stream is framed and buffered at 3006.The digital pressure stream is then scaled and normalized within each ofa plurality of epochs in time and transform domains 3008. The digitalpressure stream is framed/buffered at 3006. A deep learning model isused to fuse 3010 the digital acoustic stream and the digital pressurestream.

For example, the digital acoustic stream and the digital pressure streammay both be scaled and normalized so that their values are distributedacross the same range (e.g., 0 to 1, −1 to +1). This type ofpre-processing may be performed, for example, so that both signals maycarry comparable weights in the Deep Learning Fusion process 3010. Forexample, if an un-processed digital acoustic stream had a scale of 0 to1, while an unprocessed digital pressure stream had a scale of 0 to 100,the fusing by machine learning 3010 would either weight the unprocesseddigital pressure stream much more heavily than the digital acousticstream, or the fusing by machine learning 3010 would need to be modifiedto work with streams having different scales. Similarly, the digitalacoustic stream and the digital pressure stream may both be normalizedrespectively so that the values in each stream conform to normaldistributions. The process of scaling and normalization may also haveother benefits, such as suppressing the influence of outlier data, whichmay be the product of a noisy signal and not the product of an actualphysical phenomena being measured. Said another way, the scaling andnormalization processes 3004 and 3008 pre-process the data streams tocreate comparable data streams where variance in one stream is ofcomparable type and magnitude with other streams. Furthermore, after thescaling and normalization processes 3004 and 3008, the two input signalsmay be reweighted (e.g., 0.7 for acoustic and 0.3 for pressure streams)so that the influence of the two modalities may be adjusted for theoutcome (snore/breathing parameters).

In the fusing by deep learning process 3010, the deep learning networkssuch as Deep Neural Network (DNN), Convolutional Neural Networks (CNN)and Recurrent Neural Networks (RNN) can be used. The deep learningnetwork (e.g., DNN) receives a composite input (e.g., scaled andnormalized values of acoustic and pressure data epochs) and makes aprediction about snore/breathing parameters 3012. The Deep LearningNetwork is trained offline based on the labeled acoustic and pressuredata. Model training involves optimizing the internal weights, biases,and activation functions of the deep network using, for example, abackpropagation algorithm such that the loss between the annotatedoutcomes and model predictions is minimal. Such optimization can beperformed using optimization algorithms such as a Gradient Descent thatminimizes the loss progressively by iteratively adjusting the parametersof the model. Once the loss is minimized the training is said tocomplete, i.e., the model parameters are learned and can be used forinference. The model performance can be tested on a separate set ofannotated data not used for training. Once model performance issatisfactory it can be used for classifying new acoustic/pressurestreams into snore/breathing parameters.

What is claimed is:
 1. A bed system comprising: a mattress to support auser; an acoustic sensor configured to sense acoustic energy in theenvironment of the user; a pressure sensor configured to sense pressureapplied to the mattress by the user laying on the mattress; and acontroller configured to: receive an acoustic stream from the acousticsensor, the acoustic stream representing the acoustic energy sensed bythe acoustic sensor; receive a pressure stream from the pressure sensor,the pressure stream representing the pressure sensed by the pressuresensor; combine the acoustic stream and the pressure stream in order togenerate a set of snore/breath parameters; determine that ahome-automation rule includes a condition that includes the generatedset of snore/breath parameters; and responsive to determining that ahome-automation rule includes a condition that includes the generatedset of snore/breath parameters, send an instruction to drive acontrollable device to the controllable device.
 2. The bed system ofclaim 1, the system further comprising the controllable device, thecontrollable device configured to: receive the instruction to drive thecontrollable device; and responsive to receiving the instruction todrive the controllable device, drive in order to alter the environmentof the user.
 3. The system of claim 1, wherein to combine the acousticstream and the pressure stream, the controller is further configured to:determine respiratory parameters based on instantaneous pressuresignals; determine respiratory parameters based on instantaneousacoustic signals; and identify incidences of matching of both therespiratory parameters based on instantaneous pressure signals and ofthe respiratory parameters based on instantaneous acoustic signals. 4.The system of claim 1, wherein to combine the acoustic stream and thepressure stream, the controller is further configured to: identifyfeatures of potential snores and breaths from the acoustic stream;identify features of potential snores and breaths from the pressurestream; and identify agreements of the potential snores and breaths fromthe acoustic stream and of the potential snores and breaths from thepressure stream.
 5. The system of claim 1, wherein to combine theacoustic stream and the pressure stream, the controller is furtherconfigured to: determine that the user is present in on the mattress;determine that the user is asleep; and responsive to determining thatthe user is present in on the mattress and that the user is asleep,generate a vote to represent a candidate set of snore/breath parameters.6. The system of claim 1, wherein to combine the acoustic stream and thepressure stream, the controller is further configured to: apply theacoustic stream and the pressure stream to one or more fusion algorithmsthat each are configured to, responsive to receiving both an acousticstream and a pressure stream, generate a vote to represent a candidateset of snore/breath parameters that describe the snoring and breathingaction of the user on the bed; tallying the votes in order to determinea winning set of snore/breath parameters; select the winning set ofsnore/breath parameters as the generated set of snore/breath parameters.7. The system of claim 1, wherein the acoustic sensor comprises: asignal conditioner; and a digitizer; wherein the acoustic stream is adigital stream of data.
 8. The system of claim 1, wherein the pressuresensor comprises: a signal conditioner; and a digitizer; wherein thepressure stream is a digital stream of data.
 9. The system of claim 1,wherein to combine the acoustic stream and the pressure stream in orderto generate a set of snore/breath parameters, the controller isconfigured to: receive both the acoustic stream and the pressure streaminto a single buffer; after receiving both the acoustic stream and thepressure stream into a single buffer, normalize the acoustic stream in aparticular domain; after receiving both the acoustic stream and thepressure stream into a single buffer, separately normalizing thepressure stream in the particular domain; and fuse the normalizedpressure stream and the normalized acoustic stream to compute the set ofsnore/breath parameters.
 10. The system of claim 1, wherein to combinethe acoustic stream and the pressure stream in order to generate a setof snore/breath parameters, the controller is configured to: receive theacoustic stream into an acoustic buffer; receive the pressure streaminto a pressure buffer separate from the acoustic buffer; estimateacoustic parameters in a particular domain; estimate pressure parametersin the particular domain; and fuse the estimated acoustic parameterswith the estimated pressure parameters.
 11. The system of claim 1,wherein combine the acoustic stream and the pressure stream in order togenerate a set of snore/breath parameters, the controller is configuredto: compute acoustic features in a particular domain; compute pressurefeatures in another particular domain; and apply machine learningclassifiers to both the acoustic features and the pressure features, tocompute the overall snore/breathing parameters and status.
 12. Thesystem of claim 1, wherein to combine the acoustic stream and thepressure stream in order to generate a set of snore/breath parameters,the controller is configured to: receive both the acoustic stream andthe pressure stream into a single buffer; normalize the acoustic streamin a particular domain; separately normalizing the pressure stream inthe particular domain; and operate a deep-learning model on thenormalized pressure stream and the normalized acoustic stream so thatthey are optimally fused to compute the status and parameters ofbreathing and snoring.
 13. A controller configured to: receive anacoustic stream from an acoustic sensor configured to sense acousticenergy in an environment of a user, the acoustic stream representing theacoustic energy sensed by the acoustic sensor; receive a pressure streamfrom a pressure sensor, the pressure stream representing the pressuresensed by the pressure sensor configured to sense pressure applied to amattress by the user laying on the mattress; combine the acoustic streamand the pressure stream in order to generate a set of snore/breathparameters; determine that a home-automation rule includes a conditionthat includes the generated set of snore/breath parameters; andresponsive to determining that a home-automation rule includes acondition that includes the generated set of snore/breath parameters,send an instruction to drive a controllable device to the controllabledevice.
 14. The controller of claim 13, wherein to combine the acousticstream and the pressure stream, the controller is further configured to:determine respiratory parameters based on instantaneous pressuresignals; determine respiratory parameters based on instantaneousacoustic signals; and identify incidences of matching of both therespiratory parameters based on instantaneous pressure signals and ofthe respiratory parameters based on instantaneous acoustic signals. 15.The controller of claim 13, wherein to combine the acoustic stream andthe pressure stream, the controller is further configured to: identifyfeatures of potential snores and breaths from the acoustic stream;identify features of potential snores and breaths from the pressurestream; and identify agreements of the potential snores and breaths fromthe acoustic stream and of the potential snores and breaths from thepressure stream.
 16. The controller of claim 13, wherein to combine theacoustic stream and the pressure stream, the controller is furtherconfigured to: determine that the user is present in on the mattress;determine that the user is asleep; and responsive to determining thatthe user is present in on the mattress and that the user is asleep,generate a vote to represent a candidate set of snore/breath parameters.17. The controller of claim 13, wherein to combine the acoustic streamand the pressure stream, the controller is further configured to: applythe acoustic stream and the pressure stream to one or more fusionalgorithms that each are configured to, responsive to receiving both anacoustic stream and a pressure stream, generate a vote to represent acandidate set of snore/breath parameters that describe the snoring andbreathing action of the user on the bed; tallying the votes in order todetermine a winning set of snore/breath parameters; select the winningset of snore/breath parameters as the generated set of snore/breathparameters.
 18. The controller of claim 13, wherein to combine theacoustic stream and the pressure stream in order to generate a set ofsnore/breath parameters, the controller is configured to: receive boththe acoustic stream and the pressure stream into a single buffer; afterreceiving both the acoustic stream and the pressure stream into a singlebuffer, normalize the acoustic stream in a particular domain; afterreceiving both the acoustic stream and the pressure stream into a singlebuffer, separately normalizing the pressure stream in the particulardomain; and fuse the normalized pressure stream and the normalizedacoustic stream to optimally determine the set of snore/breathparameters.
 19. The controller of claim 13, wherein combine the acousticstream and the pressure stream in order to generate a set ofsnore/breath parameters, the controller is configured to: computeacoustic features in a particular domain; compute pressure features inthe same or another particular domain; and apply machine learningclassifiers to both the acoustic features and the pressure features tooptimally determine the set of snore/breathing parameters.
 20. Thecontroller of claim 13, wherein to combine the acoustic stream and thepressure stream in order to generate a set of snore/breath parameters,the controller is configured to: receive both the acoustic stream andthe pressure stream into a single buffer; normalize the acoustic streamin a particular domain; separately normalizing the pressure stream inthe particular domain; and operate a deep-learning model on thenormalized pressure stream and the normalized acoustic stream.